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ABSTRACT 



The role of negative instances in the acquisition of the 
mathematicaa concepts of commutativity and associativity of a 
binary operation was examined. Two levels of instruction for 
commutativity (positive instances and positive and negative 
instances) and the same levels of instruction for associativity 
were crossed to form a 2 x 2 factorial design with l6 ninth 
grade subjects per cell. Criterion variables were number of 
correct responses^ stimulus interval^ and postfeedback interval 
during treatments and/or post tests. The results appear', i to 
favor the treatments containing both positive and ne^^r* e 
instances and supported the hypotheses that the effecL of 
negative instances transferred from one concept to another. 
There were cdternate explanations proposed for the results 
€md further studies were urged. 
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INTRODUCTION 



Negative instances have been considered by mathematicians to be 
essential to the understanding of advanced mathematical concepts 
(Gelbaum and Olmsted, 19&^i Steen and Seebach, 1970). Dienes (196'^) 
argues for the ixse of negative instances in the teaching of mathematics 
to elementaiy and secondary school children. Bereiter and Engl,einan 
(1966) and Markle and Tianazm (1970) state explicitly that all instruc- 
tional sequraces designed for concept learning should include negative 
instances. Yet, Clark (1971), in a review of over 250 experimental 
studies in concept attainment, found 26 studies idiich reported a 
debilitating effect of negative instances on concept attainment and 
only 11 which did not support such a position. Markle and Tiemann 
(1972) state that, despite such laboratory evidence, positive and nega- 
tive instances "are of equal importance in the teaching of real concepts." 
Bourne and Dominowski (1972) in a review of research siqpport the conten- 
tion that for simple, conjunctive concepts, a series of positive 
instances is to be favored over any mixture of positive and negative 
instances, but that for more difficult concepts, such as disjunction 
the advantage of positive instances is either absent or negative 
instances are favored. Both Clark (l97l) and Bourne (1967), agree 
that the research in concept attainment is restricted in nature and 
that the concepts studied in schools are quite different. There is 
some evidence from recent educational research that negative instances 
are valuable canponents of classroom instruction (Tennyson, Woolley, 
and Merrill, 1971; Shumway, 1971)* 

The study is designed to investigate two questions about the role 
of negative instances in the acquisition of the mathematical concepts 
of comvutativity and associativity of a binary operation. 

1. What are the different effects of an instructional sequence 
of positive and negative instances and a sequence of all 
positive instances in the acquisition of conmutativlty 
and/or associativity? 

2. Assuming there are effects for negative instanc^^s, do 

the effects of negative instances for one conept trans- 
fer to another ccmcept? 

Background 

Mathematicians (Gelbaum and Olmsted, 19&^i Steen and Heebach, 1970), 
mathematics educators (Dienes, 1961^; Shumway, 1970), and educational 
psychologists (Bereiter and Engelman, 1966; Markle and Tiemann, 1970) 
have all advocated the use of negative instances for instruction. 
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Several studies involving concepts defined over finite universal 
classes using the dimensions of color , size, and shape have been carried 
out to investigate the role of positive and negative instances in the 
formation of simple concepts. In reporting one of the earliest of such 
studies. Smoke (1933) states that although there were no significant 
differences found in the rate at Tirtiich concepts were learned when series 
of positive instances were compared with mixed series of both positive 
and negative instances, there was some evidence that negative instances 
tended to discourage 'snap judgments* on the part of the subjects during 
the learning of diffictilt concepts. 

Hovland (1952) noted that the relative size of the class of positive 
instances and the class of negative instances introduced variability 
into the amount of infoxmation a pajrbiaalar instance ccmntunicated. 
Even ^Aien the amount of information instances communicated was equated, 
Hovland and Weiss (1953) found that more subjects conqpleted their task 
successfully when the instances were positive than when the instances 
were a mixture of positive and negative instances or \Aien the instances 
were all negative. Bruner, Goodnow, and Austin (1956) and others support 
the results of Hovland and Weiss (Glanzer, Huttenlocher, and Clark, 
1963; Haygood and Devine, 1967; Mayzner, 1962). 

Research has also shown that subjects seem to have both an inability 
and an unwillingness to use negative instances (Bruner, et al., 1956, 
Dcminowski, 1S)68; Donaldson, 1959> Wojtaszek, 1971)- It has been sug- 
gested that negative verbal information is simply more difficult for 
subjects to handle (Donaldson, 1959$ Gough, 1965; Johnson^Laird and 
Tagart, 1969; Tavrow, 1966; Wales and Grieve, 1969; Wason, 1959). 
Others have suggested that the strategies used by the subjects do not 
>eem to be conqpatible with effective use of negative instances (Bruner, 
et al., 1956; Bral^, 1963; Conant and TrfiO^asso, 196lf; Davidson, 1969; 
Denny and Ben j afield, 1969; Dervin and Def f enbacher , 1970; Duncan, 196^*; 
Eifermann and Steinitz, 1971; Gough, I965; Huttenlocher, 1967; O'Neill, 
1969; Tagatz, et al., 1968; Wickelgren and Cohen, I962). 

In general, support of the theory that subjects are unfamiliar with 
the use of negative instances, Ereibergs and Tulving (196I) have shown 
that although initial differences in median time to solution between 
subjects using positive instances and subjects using negative instances 
favor subjects using positive instances, these differences are virttially 
nonexistent ai. the end of a 20-problem series. The results of Chlebek 
and Dominowskl (1970), Fryatt and Tulving (1963)> Haygood and Stevenson 
(1967), Tavrow (1966), and Weber and Woodward (1966) appear to support 
the conte^ition that subjects can learn to use negative instances as 
effectively as positive instances. 

It hris also been pointed out by Bnmer et al. (1956) that the 
nature of the rule defining the concept is related to the role which 
negative instances play. Conant (1966) reports that for disjunctive 
concepts, mixed series of positive and negative instances are favored 



over an all-positive series. Huttenlocher (1962, I96U) reports that 
for one-dimensional concepts, a mixed series of positive and negative 
series is favored over any other. Bourne and Guy (I968) report that 
in addition to confirming the restilts of Hovland and Weiss (1953) con- 
cerning the role of negative instances in conjunctive concept formation 
and the res\ats of Hunt and Hovland (196O) concerning the relative 
difficulty of conjunctive, disjunctive, and conditional concept forma- 
tion, it was also found that for rule learning (attributes given, rule 
unknown), subjects performed best on all rules \Aien a mixture of posi- 
tive and negative instances was presented. Recent research suggests 
that there is an interaction between usefulness of negative instances 
and the nature of the conceptual rule (Bourne and Ekstrand, 1969; 
Fraunfelker, I97I; Giainbra, I969; Krebs, 1970; Schaveneveldt, I966; 
Shore and Sechrest^ I96I; Taplin, 1971; Weber and Woodward, I966). 

In all of the investigations cited from experimental psychology 
the concepts studied were simple conc'^pts defined over a finite universal 
class. It would seem appropriate to investigate concepts where the 
universal class wsis infinite and the concepts were of the more compli- 
cated type encountered in the study of mathematics. Wason (196O) reports 
that in using semi-mathematical concepts defined over an infinite uni- 
versal class, the successful students were the ones who covild suggest 
negative instances to test in the process of discovering a concept. 

A second observation concerning the Investigations cites is that 
the training sequence is somevrtiat different than that encountered in 
school learning. The subjects were given a series of instances and were 
asked to discover the concept by examining the instances. It is common 
^procedure in school learning to first present the subject with the 
definition of the concept and then examine a series of instances in 
order to learn the concept (Ausubel, 1968). Erase (1972) supports this 
point by making a distinction between concept definition and concept 
formation. 

Markle and Tiemann (1972) and Gagne (1965) sxiggest that in school 
learning the subject is to classify new Instances \rtiich have not previ- 
ously been seen. Clark (1971) describes the critical differences between 
the concept attainment tasks of experimental research and concepts in 
the classroom and calls for research in the content areas to bridge the 
gap. Cronbach (1957), Pereboom (1971), and Tagatz, Melnke, and Lenke 
(1968) have also called for studies in specific content areas • Some 
exanqples of such studies are those of Markle and Tiem an n (1972), Marine 
(1972), and Tennyson, Woolley, and Merrill (1971) supporting th'j use of 
positive and negative Instances and Dossey (1972) favoring positive 
instances over negative instances. In a study by this author, series 
of all positive instances and series of mixed positive and negative 
instances were used with mathematical concepts defined on infinite 
universal classes in the oisual classroom setting ifAiere the instances 
were preceded by a definition of the concept (Sh\amway, 1970). The re- 
sults suggest that lAien subjects are tested on a concept with new 



instances, positive and negative instances axe favored over subjects 
trained with positive instances alone. An alternate explanation could 
be that negative instances simply taught the subjects to be skeptical, 
independent of the particular concept being learned. It is the goal of 
the present study to determine vrtiether negative instances have an effect 
on concept learning and vrtiether this effect transfers from one concept 
to rmother. 



lly^)otheses 

The first requisite is a definition for concept . As Kendler (196^^) 
has pointed out, none of the many definitions of concept given in the 
literature can be considered totally adequate since they do not adequately 
characterize such concepts as color, time, space, etc. For the purposes 
of an experimental study, the most useful definitions are those given by 
Hovland (1952), Kendler (196I), Hunt (1962), Bourne (1966), and others 
in the field of experimental psychology. We choose to luse components of 
the definitions of Kendler and Hunt. 

A concept is a partitioning of a class X into two disjoint classes 
Xi and X^* The elements of the class X, are called positive instances 
of the concept and elements of the class X2 are called negative instances 
of the concept. The class X is called the universal class over which 
the concept is defined. The notion of partition requires that the class 
X be the union of the class Xi and the class X2 and that the classes Xx 
and X'> are disjoint. To say that a sub.iect knows the concept over the 
class X is to say that given any object from the class X the student is 
able to identify the object as a member of the class Xi or the class X2 
associated with the concept over the class X. For example, a subject 
knows the concept pencil over the class of all objects in a particular 
schoolroom; if given any object from that schoolroom, the student is 
able to identify the object as either a pencil (an element of Xx) or a 
non-pencil (an element of X2). The definition requires that this can 
be done with every ob.ject in the given schoolroom (every element of X)* 
In analyzing l^he definition formally, it is clear that one need only be 
able to identify the elements of two of the three classes X, Xx, and X2 
in order to know the concept over the class X. This follows from the 
results that 



X = Xx U X2, Xx = X - X2, and 3fe = X - Xx . 



This observation would seem to sxiggest three possible strategies 
for the maximally efficient learning of a given concept over a class X 
with partition Xx, X,-.. Namely, the student would learn to identify the 
classes 



X and X2, or X and or X and Xx 



If one allows for redundancy, a fourth strategy can be added; the student 
would learn to identify the classes 



X, Xx, Biid X2« 



Negative instances play a role in three of the four strategies. 

The major problem investigated w; v 'cct that negative instances 

have on the formation of mathematical v..^.-^opts and if that effect trans- 
fers from one concept to another. Two mathematical concepts over the 
infinite class of all binary operations on the sets of natural, integral, 
and rational numbers were used. Concept A was commutativity of a binary 
operation and Concept B was associativity of a binary operation. All 
treatments for the acquisition of Concepts A and B were a series of 
instances which the subject was required to classify as a positive or 
negative instance of the concept. The treataaent for Concept A consisting 
of only positive instances was denoted by A+, the treatment consisting 
of positive and negative instances was denoted by A±. The treatments 
Bf and Bi were defined similarly. Figure 1 specifies the four treatment 
groups . 



A+ Ai 



A+Bf 


A±Bf 


A+B+ 


A±B+ 



Figure 1. Treatment groups 



The class X for Concepts A and B is infinite. Each of the four 
treatments specified in the above table connisted of kO instances, 20 
for Concept A and 20 for Concept B. In the cases where both positive 
and negative instances were presented, 10 were positive and 10 were 
negative. The treatments were administered by IBM 27^1 computer 
termina^,s. 



The following definitions were made: 



Binary operation ; A binary operation ^ on a set S is a cor- 
respondence which associates with every ordered pair (a,b) of 
elements of S a unique element a -^^ b of S. 

Commutative ; A binary operation -^^ on a set S is said to be 
commutative if and only if for every a and b in S, 
a b = b ^ a. 

Associative ; A binary operation on a set S is said to be 
associative if and only if for every a, b, and c in S, 
a * (b * c) = (a * b) * c. 

Stimulus interval ; The stimulus interval is the length of 
time the stimulus is available to the subject for inspection. 

Postfeedback interval ; The postfeedback interval is the 
length of time between the presentation of the feedback and 
the occurrence of the next stimulus. 

Delay of informative feedback ; The delay of informative 
feedbLck is the length of time between the subject *s response 
to a question and the presentation of the feedback associated 
with the subject *s response. 

A sample instance during the treatment follows; 

Stimulus : 

1. a o b = 2 + b + a, 3 o U = 9, 0 o 1 = 3- 

aob = boa? 
Response ; 

y 

Feedback ; 

Correct • 

Response : 

Hit 'return key' to receive next stimulus. 

The stimulus interval was taken to be the length of time between 
the end of the typing of the stimulus, i.e., the symbol "?," and the 
entering of the symbol ''y," the response. There was no delay of the 
informative feedback. As soon as the response was entered, the 
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feedback was typed. The postfeedback interval was taken to be the 
length of time between the typing of the feedback and the subject's 
hitting of the return key to receive the next stimulus. 

The following hypotheses were tested: There is no significant 
interaction or main effects for levels of A (A+, A±) and levels of B 
(B^-, B±) in: 

I. Mean number of correct identifications for 

a) criterion measure fox* Concept A; 

b) criterion meas\ire for Concept B. 

II. Mean total stimulus interval and postfeedback 
interval during 

a) treatment for Concept A; 

b) treatment for Concept B; 

c) criterion measure for Concept A; 

d) criterion measure for Concept B. 




METHODS 



S ubjects 5 Design^ and Treatments 

A random sample of 85 of klO ninth grade students from Clinton 
Junior High School were identified as the subject pool from which (jh 
subjects were raiidcmly assigned in equal numbers to four treatments. 
Appendix Aj6 documents the subjects dropi ''d and the reasons for the 
drops. Appendix A. 7 briefly describes the pilot studies and the time 
schedule of the experiment. The mean verbal I.Q. on the California 
Short Form Test of Mental Maturity for the students of Clinton was 105 . 
Clinton students averaged airproxiinately one grade level above the 
average for the total Columbus Public School population in standardized 
measures of reading, language, and arithmetic (Merriman, I969). 

Concept A was defined to be comrautativity of a binary operation 
and Concept B was defined to be associativity of a. binary operation. 
The symbol A+ denoted a treatment of 20 positive instances of Concept A 
and the symbol A^ denoted a treatment of 10 positive instances ,and 10 
negative instances of Concept A. The symbols Bf and B± were defined, 
similarly. Figure 2 specifies the 2x2 design matrix. Each treatment 
consisted of ko instances in a fixed but random order. Each of the 
four treatments is given in full in Appendix A.U. 



A+ A± * 



A+Bf 


A+Bf 


A+B+ 


A+B+ 



Figure 2. Design matrix 



Table I specifies the nimiber and type of instances for each treatment 



TmE I 



NUMBER AND TYPE OF TREATMENT INSTANCES PER CELL 
AND NUMBER OF SUBJECTS PER CELL 







Number and Type 


of Instances 




Number of 


Cell 


Treal-meni. 


Concept 


A . 


Concept B 


Total 


Subjects 






Positive Negative 


Positive Negative 




Per Cell 


11 


A+Bf 


20 


0 


20 0 


ko 


16 


12 


A'Bf 


10 


10 • 


20" 0 


ko 


16 


21 


A+B± 


20 


0 


10 10 


ko 


16 


22 


A+Bi: 


10 


10 


10 10 


ko 


16 



■'Item foiirteen for cell 12 was scored as a positive instance and the 
subjects received feedback which identified the instance as positive* 
In fact, however, the instance was negative and some would argue that 
cell 12 received 19 positive Instances of Concept B and 1 negative 
instance . 



A sample instance from treatment A+Bf follows: 
Stimulus : 

1. a o b = b + a + 2,. 3 o 1 = 6, U o 5 = 

(a o b) o c a o (b o c) ? 
Response ; 
n 

Feedback ; 

Incorrect. 

Response : 

* Return key' • 
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Instzatments 



The treatments were administered with an IBM 360/5O computer and 
IBM 27UI computer tezminals. The programming language was Coursewriter 
III, version 2 (IBM, 1969)« Stimulus intervals and postfeedback inter- 
vals for each item were recorded as well as the students * responses . 
Sample student interaction and computer programming for each treatment 
are displayed in Appendix A.U. 

A random sample of 10 of the 20 binary operations used for the 
posttests (POA and FOB) were used for the calculational pretests PCA 
and PCB. Stimulus Intervals were recorded during both pretests. 

The items for PCA and PCB were randomly ordered in pairs, operation 
by operation. A sample item of PCA and PCB follows: 

Stimulus : 

a o b = 2 ^ (a - b), 3 o 1 = U, 7 o 2 = 10, 

3. 5 o 2 = ? (PCB) 
Response : 
6 

stimulus : 

h. 9 o (7 o 3) = ? (PCB) 

Response : 
2 

A complete list of items for the pretests PCA and PCB are given in 
Appendix A. 3. Table II gives reliability estimates for the subjects 
of the experiment. Both PCA and PCB proved to have reliabixxty estimates 
in excess of .80. 
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TABLE II 

RELIABILITY ESTIMATES FOR PRETESTS 



Instniment 


Number 


Reliability 


of Items 


Estimate* 


rCA + PCB 


20 


.89 


Subtests : 






PCA 


10 


.81 


PCB 


10 


.88 



PCA + PCB - Pretest, Calcxilations without and with parenthesis 

PCA - Subscore of Pretest, Calciilations without parenthesis 
PCB - Subscore of Pretest, Calculations with parenthesis 
^Kuder-Richardson Formula 20 reliability estimate. 



The posttests for Concept A and Concept B, POA and POB consisted 
of 20 binary operations not in ai^ of the treatments . A sample item 
of POA and POB follows: 

Stimulus : 

1. a o b = 2(a 

(a o b) o c 

Response ; 

y 

stimulus ; 

aob = boa? 
Response ; 

y 

stimulus intervals were recorded for all items of POA and POB. A 
complete list of items for the posttest POA and POB may be found in 
Appendix A. 4. Table HI gives the number and type of instances for POA 
and POB, as well as the reliability estimates of .5^ and .45. A possible 
explanation for the magnitude of these reliabilities will be given in 
the Conclusions section. 



- b), 3 o 1 = U, 5 o 2 = 6. 
-ao(boc)? 
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TABLE III 



NUMIER OF INSTANCES, TYPE OF INSTANCES, AND 
miABILITY ESTIMATES OF POSTTESTS FOR 
CONCEPT A AND CONCEPT B (POA AND FOB) 





Number of Instances 


Reliability 


Instrment 


Positive 


Negative 


Total 


Estimate'' 


FQA 


10 


10 


20 




FOB 


7* 


13 


20 





''Ruder-Richardson Formula 20 reliability estimate. 

^'Positive and negative instances are unbalanced because of the difficxilty 
in finding simple, cammxtative but not associative binary operations. 



Figure 3 gives a flow chart of the complete experimental sequence. 
There were three sessions at the computer terminal. The first, lasting 
approximately 30 minutes, consisted of an introduction to binary oper- 
ations and pretests PCA and PCB. The second session, xxsually the 
following day, consisted of a brief introduction and one of the four 
eacperlmental treatments and took approximately 25 minutes. The third 
session, usually on the third day, consisted of the two posttests, POA 
and POB and took approxdinately 25 minutes. In all cases students com- 
pleted all three sessions within seven days* The four ccoputer terminals 
were placed in an acoustically prepared room at Clinton Junior High 
School. Students reported to the computer terminal during their study 
hall or in some cases their mathematics class. One or two monitors 
were available at all times to insure proper operation of the computer 
terminal and to detect any deviations in terminal performance. Approxi- 
mately 20 students were processed per week from January 17, 1972 to 
February 25, 1972. Students were randomly assigned to treatments 
before being scheduled for the administration of the experiment. 

For the experiment, the independent variables were: 

1. Levels of A (A+ or A±) 

2. Levels of B (B+ or B± 

3. PCA - Pretest calculations without parentheses; 
PCB - Pretefjc calculations with parentheses; 

5. PCSIA - Total Stimulus Interval for PCA; 

6. PCSIB - Total Stimulus Interval for PCB; 
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TREATMENT A*B* 
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N>I6 




Figure 3. Flow cliaxt of experiment 
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TREATMENT A" B' 
N = I6 
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and the dependent variables were: 

!• POA - Posttest for Concept A; 
2. FOB - Posttest for Concept B; 

3# POSIA - Total Stimulus Interval for POA; 

h. POSIB - Total Stimulus Interval for POB; 

5# TSIA - Total Stimulus Interval during Treatment for Concept A 

6* TSIB - Total Stimulus Interval during Treatment for Concept B 

?• TPIA - Total Postfeedback Interval during Treatment for 
Concept A; 

8* TPIB - Total Postfeedback Interval during Treatment for 
Concept B; 



The design may be diagrammed as follows: 

R3 0?0§oM (X3cM)i35) (M)it)| 

R* O?O§O?0i (X4(M)io5) o|o|oS)i 

vhere Ri-IU are the four groups, X1-X4 are the four treatments and 
OjL and 0^ are defined as follows: 

of - VCk 0^ - TSIA 0§ - lOA 

O2 - ICSIA - TPIA Og - POSIA 

B n 

Oi - pan 03 - TSIB of - POB 

of - PCSIB O4 - TPIB Oi - POSIB 
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Thus, given the 2x2 design matrix 



A+ A'- 



A+Bf 


A±Bf 


A+B± 


A±B± 



The following hypotheses were tested: There is no significant 
interaction or main effects for levels of A and levels of B in: 

I. Achievement: mean perfomance on 

a) POA; 

b) FOB; 

II. Time: mean total on 

a) TSIA; 

b) TSIB; 

c) TPIA; 

d) TPIB; 

e) POSIA; 

f) POSIB. 



Analysis 

The data were analyzed using the Clyde MANOVA program for a multi- 
variate two-way analysis of covariance (Clyde, I969). Because of the 
symmetry of the design the resvQts for Concept B were viewed as a poten- 
tial replication for the results for Concept A. Hence, the analysis 
for Concept B was done separately from the analysis for Concept A. 
Achievement variables were separated from time variables. 



16 



RESULTS 



Pretest Analysis 

Table IV s\3inmarizes the means and standard deviations for each 
cell on the pretest measures related to Concept A. The means of 6 out 
of a maximum of 10 indicate that subjects were reasonably skiUful at 
calculations without parentheses for new binary operations* 



TABLE IV 

CELL MEANS AND STANDARD DEVIATIONS FOR 
PRETESTS RELATED TO CONCEPT A (PCA AND PSIA) 



Cell 


Treatment 


Statistic 


PCA 


PSIA* 


• 11 


A+Bf 


M 


6.063 


185.000 






SD 


2.816 


97.175 


12 


A±Bf 


M 


6.313 


225.188 






SD 


3.2U0 


138.705 


21 


A+B± 


M 


5.500 


230.688 






SD 


2.338 


IO9.8I+2 


22 


A±B± 


M 


6.250 


218.000 






SD 


2.769 


127.300 



M - Mean, SD - Standard Deviation 
^tijnul\is intervals are in seconds. 



The pretests PCA and PSIA were subject to multivariate and uni- 
variate analysis of variance to determine if significant differences 
existed between groups on meas\ires related to Concept A before the 
treatments. Table V summarizes the results of the analysis. No 
p-values were less- than *35* 



17 



TABLE V 



MIII,TIVARIATE AND UNIVARIATE ANALYSIS OF VARIANCE 
OF PRETESTS RELATED TO CONCEPT A (PCA AND VSIA) 



Variable(s) 


Test 


Source 


df 


F 


p < 


PCA, PSIA 
PCA 
PSIA 


M 
U 
U 


AxB 


2,59 
1,60 
1,60 


0.413 
0.127 
0.785 


.664 
.723 
.379 


PCA, PSIA 
PCA 
PSIA 


M 

U 
U 


A 


2,59 
1,60 
1,60 


0.408 

0.507 
0.212 


.667 
M9 
.647 


PCA, PSIA 
PCA 
PSIA 


N 

U 

u 


B 


2,59 
1,60 
1,60 


0.267 
0.198 

- 0.416 


.766 
.658 
.521 



Multivariate test, U - Univariate test 



Table VI summarizes the means and standard deviations for each 
cell on the pretest measures related to Concept B. The means of 3 out 
of a majciffluir. of 10 suggest that not all subjects were successflil at 
calculations with parentheses for new binary operations. As on the 
pretests for Concept A, the subjects of cell 21 appears to be less 
skillful than the subjects of the other three cells, 

TABLE VI 

CELL MEANS AND STANDABD DEVIATIONS FOR 
PRETESTS RELATED TO CONCEPT B (PCB AND PSIB) 



Cell 


Treatment 


Statistic 


PCB 


PSIB* 


11 


A+Bf 


M 


3.250 


283.000 






SD 


3.191+ 


130.774 


12 


A+Bf 


M 


3.688 


298.625 






SD 


3.301 


128.094 


21 


. A+B± 


M 


1.125 


378.313 






SD 


1.204 


211.431 


22 


A+Bt 


N 


2.875 


275.250 






SD 


2.986. 


122.181 



M - Mean, SD - Standard Deviation 
""Stimulus intervals are in seconds 
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The pretests PCB and PS IB were subjected to a m\iLtivariate and 
univariate analysis of variance to determine if significant differences 
existed between groups on measures relsted to Concept B before the 
treatments. Table VII summarizes the restilts of the analysis. While 
the multivariate tests were not significant, a imivariate test on 
PCB was significant (p < .05). 



TABLE .VII 

MULTIVARIATE AND UNIVARIATE ANALYSIS OF VARIANCE 
OF PRETESTS RELATED TO CONCEPT B (PCB AND PSIB) 



Variable(s) 


Test 


Source 


df 


F 


P < 


PCB, PSIB 


M 


AxB 


2,59 


1.1+81 


.236 


PCB 


U 




1,60 


0.876 


.353 


PSIB 


U 




1,60 


2.U20 


.125 


PCB, PSIB 


M 


A 


2,59 


1.669 


.197 


PCB 


U 




1,60 


2.U33 


.121+ 


PSIB 


U 




1,60 


1.313 


.256 


PCB, ^XB 


M 


B 


2,59 


2.U10 


.099 




U 




1,60 


I+.388 


.OlK>» 


PbiB 


U 




1,60 


0.889 


.350 



M - Multivariate test, U - Uhivariate test 
*p < .05 



Because the pretests appeared to be fairly reliable (r > .80), the 
groups appeared to differ on at least one of the pretests, and not all 
subjects were sttccessftil on the pretests, covariance procedures were 
chosen for the analysis. 



Achievement 5 Concept A (POA) 

Table VIII gives the unadjusted means and standard deviations for 
the posttest related to Concept A (PDA). 
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TABLE VIII 



CELL MEANS AND STANDARD DEVIATIONS FOR 
POSTTEST RELATED TO CONCEPT A (POA) 



Cell 


Trealanent 


Statistic 


POA 


11 


A+Bf 


M 
SD 


U.875 
2.729 


12 


A+Bf 


M 

SD 


12.563 


21 


A+B± 


M 

SD 


12.063 
2.59^ 


22 


A±B± 


M 

SD 


13.313 
2.056 



M - Mean, SD - Standard Deviation 



The variable POA, as the major criterion variable for Concept A, 
was analyzed using a univariate analysis of covariance with PCA as 
covariate. The use of PCB as a covariate was rejected as no calcula- 
tions with parentheses are required to classify the instances of POA. 
Table IX summarizes the results of the analysis of POA. While the 
regression was significant (p < .004) no p-values for interaction or 
main effects were less than .2. 



TABLE n 

ANALYSIS OF COVARIANCE FOR CONCEPT A OF POA USING PCA AS COVARIATE 



Source 


df 


F 


P < 


Equality of 
Regression 


3,56 


0.310 


.818 


Regression 


1,59 


8.987 


,00k** 


A X B 


1,59 


0.089 


.767 


A 


1,59 


I.U85 


.228 


B 


1,59 


0.803 


.37^^ 



IXDA - Posttest for Concept A. 

PCA - Pretest, Calculations without parentheses. 

ffp < .01 
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Achievement, Concept B (FOB) 

Tabic X gives the cell means and standard deviations for the post- 
test for Concept B (FOB). 



TABLE X 

CELL MEANS AND STANDAED DEVIATIONS FOR 
POSTTEST RELATED TO CONCEPT B (FOB) 



Cell 


Treatment 


Statistic 


POB 


11 


A+Bf 


M 


8.688 






SD 


2.726 


12 


A±Bf 


M 


9.125 






SD 


2.21^7 


21 


A+B± 


M 


8.750 






SD 


2.236 


22 


A±B± 


M 


11.625 






SD 


2.705 



M - Mean, SD - Standard Deviation 



The variable POB, as the major criterion variable for Concept B, 
was analyzed using a imivariate analysis of covariance with PCA and PCB 
as covariates. Both PCA and PCB were used as covariates as the calcu- 
lations for POB required both calculations with and without parentheses. 
Table XI summarizes the resiiLts of the analysis of POB. Both the A 
effect and B effect were significant (p < .025 )♦ 
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TABLE XI 



AMLYi'.IS OF COVAEIANCE FOR CONCEPT B OF 
FOB USING PGA AND PCB AS COVARIATES 



Source 


df 


F 


P < 


Equality of 
Regression 


6,52 


7.351 


.280 


Regression 


1,58 


2.615 


.082 


A X B 


1,58 


3.195 


.079 


A 


1,58 


5.356 


.02k* 


• B 


1,58 


5.8I18 


.019* 



POB - Posttest for Concept B 
PCA - Pretest, Calculations without parentheses 
PCB - Pretest, Calculations with parentheses 
*p < .05 



Figure k shows the adjusted cell and margin means and a plot of 
the cell means. Most of the difference appears to be accounted for by 
the A±B± treatment. 



A* 



12 
ii 
10 
9 
8 




B" 



8.614 


8.954 


9.048 


11.571 



8.784 



10.310 



8.831 10263 



B* 



Figure k. Adjusted means for POB (A effect, B effect) 
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The B effect suggests that treatment B± is more effective than treatment 
B+. The A effect suggests that A± is more effective than A+. That is, 
in aaaibion to an effect for negative instances on Concept B, there 
appears to be a transfer effect ffom the treatment of negative instances 
for Concept A to achievement for Concept B. 

Time, Concept A (PCSIA, TSIA5 TPIA, POSIA) 

Table XII svumnarizes the means and standard deviations for each 
cell on the time variables for Concept A. 



TABLE XII 

CELL MEANS AND STANDARD DEVIATIONS FOR TIME VARIABLES^ RELATED 
TO CONCEPT A (PCSIA, TSIA, TPIA, AND POSIA) 



Cell 


Treatment 


Statistic 


PCSIA 


TSIA 


TPIA 


POSIA 


11 


A+Bf 


M 


185.000 


261^.938 


49.625 


138.188 






SD 


97.175 


225.804 


23.180 


100.702 


12 


A±Bf 


M 


225.188 


302.313 


63.250 


223.188 






SD 


138.705 




31.634 


97.718 


21 


A+B± 


M 


230.688 


277.875 


63.625 


166.625 






SD 


109.81f2 


159.595 


43.297 


66.635 


?22 


A+B± 


M 


218.000 


300.625 


44.063 


179.000 






SD 


127.300 


148.527 


19.999 


76.522 



M - Mean, SD - Standard Deviation 

PCSIA - Pretest, Calculations without parentheses Stimulus Interval. 
TSIA - Treatment Stimulus Interval for Concept A. 
TPIA - Treatment Postfeedback Interval for Concept A. 
POSIA - Posttest Stimulus Interval for Concept A. 
''All time variables are in seconds. 



The time variables were subjected to a mu].tivariate analysis of 
covariance. Appendix A. 9 reports the correlation matrix for all 
variables of the study. The significant correlations (p < .05) among 
some of the time variables support the use of multivariate analysis. 
(See Table XVII, Appendix A. 9). The total stimulus interval on the 
pretest (PCSIA) was used as the covariate. Table XII summarizes thfi 
results of the analysis of the time variables for Concept A. The only 
multivariate F which was significant was for the regression effect 
(p < .001). Two univariate regression effects were also significant 
(p < .001 and p < .01), TSIA and POSIA. According to Cramer and Bock 
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TABLE XIII 

MULTIVARIATE AND UNIVARIATE ANALYSIS OF COVARIANCE FOR TIME VARIABLES 
RELATED TO CONCEPT A (TSIA, TPIA, AND POSIA) USING PCS lA AS COVARIATE 



Variable(s) 


Test 


Soxirce 


df 


F 


p < 


TSIA, TPIA, 


POSIA 


M 


Equality of 


9,131.6 


1.602 


.121 




mo TA 

TSIA 


U 


Regression 


3,56 


1.792 


.159 




TPIA 


U 




3,56 


2.139 


.107 




POSIA 


u 




3,56 


2.271 


.090 


TSIA, TPIA, 


POSIA 


M 


Regression 


3,57 


6.880 


.001** 




TSIA 


U 




1,59 


20.898 


.001** 




TPIA 


IT 
U 




1,59 


0.000 


.906 




POSIA 


u 




1,59 


9.037 


.004** 


TSIA, TPIA, 


POSIA 


M 


A X B 


3,57 


2.532 


.066 




TSIA 


U 




1,59 


0.106 


.71+6 




TPIA 


u 




1,59 


U.U95 


.038* 




POSIA 


u 




1,59 


2.051+ 


.157 


TSIA, TPIA, 


POSIA 


M 


A 


3,57 




.072 




TSIA 


U 




1,59 


0.282 


.597 




TPIA 


u 




1,59 


o.iMf 


.706 




POSIA 


u 




1,59 


U.895 


.031* 


TSIA, TPIA, 


POSIA 


M 


B 


3,57 


0.158 


.921* 




TSIA 


U 




1,59 


0.053 


.819 




TPIA 


u 




1,59 


0.109 


.71+2 




POSIA 


u 




1,59 


o.Uo4 


.527 



< .05, ^ < .01 



(1966), if the multivariate test is significant, then the tmivariate 
tests can be examined with some assurance that significant effects 
exist. If we demand multivariate significance (p < .05) before exam- 
ining the univariate test, no other differences were significant. Some 
researchers have adopted the strategy of examining the tanivariate tests 
at the .05 level if the multivariate test is significant at the .10 
level (Walberg, Sorenson, and Pischbach, 1972). 

Pointing out that this strategy increases the probability of 
making a Type I error, we tentatively observe that the p-values for 
the multivariate tests for A x B and A are less than .08. The tander- 
lying univariate test of A x B for TPIA is significant (p < .05). 
Figure 5 gives the adj\xsted means for TPIA and displays a plot of the 



2k 



65 
60 
55 
50 
45 
40 - 




A' 

A* 



B- 



B* 



B" 



A* 



49.607 


63.256 


63.635 


44.064 



56.621 53.660 



56.432 



53.850 



Figure 5. Adjusted means for TPIA (A x B effect) 



interaction. We simply observe that, if the interaction is significant, 
the significance probably lies with variable TPIA. It appears that the 
.interaction is a disordinal interaction. 

The vinderlying univariate test of A for POSIA is significant 
(p < .05). Figure 6 gives the adjusted means for POSIA and a plot of 
the cell means. We observe that, if the A effect is significant, the 
significance probably lies with variable POSIA. It would appear that 
the introduction of negative instances in the treatment for Concept A 
caused subjects to spend more time responding to the items of the post- 
test for Concept A. 



220 
200 
ISO 
160 
140 




A* 



146.047 


220.419 


162.402 


178.132 



154.224 199.276 



B* 



B" 



Figure 6. Adjusted means for POSIA (A effect) 
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183.233 



170.267 



Time, Concept B (PCSIB, TSIB, TPIB. and POSIB) 



Table XIV summarizes the means and standard deviations for each 
cell on the time variables for Concept B. 



TABLE XIV 

CELL MEANS AND STANDARD DEVIATIONS FOR TIME VARIABLES^ RELATED 
TO C(»}CEPT B (PCSIB, TSIB, TPIB, AND POSIB) 



Cell 


Trealanent 


•.statistic 


PCSIB 


TSIB 


TPIB 


POSIB 


11 


A+Bf 


M 


283.000 


245.250 


48.000 


285.750 






SD 


130. 77** 


201.570 


20.59"+ 


332.169 


12 


A±Bf 


M 


298.625 


427.125 


58.813 


304.375 






SD 


I28.O9I+ 


228.676 


33.837 


130.443 


21 


A+B± 


N 


378.313 


348.438 


68.938 


280.313 






SD 


211.431 


216.302 


45.4l4 


161.453 


22 


A+B' 


N 


275.250 


373.813 


49.500 


266.375 






SD 


122.181 


171.344 


32.656 


169.930 



M - Mean, SD - Standard Deviation 

PCSIB - Pretest, Calculations with parentheses Stiimilus Interval. 
TSIB - Treatment Stlimilus Interval for Concept B* 
TPIB - Treatment Postfeedback Interval for Concept B. 
POSIB - Posttest Stlmculus Interval for Concept B. 
^All time variables are in seconds. 



As in the Concept A analysis, the time variables were subjected to 
a multivariate analysis of covariance. The total stimulus interval on 
the pretest (PCSIB) was \xsed as the covariate. Table XV summarizes the 
results of the analysis of the time variables for Concept B. Consistent 
with the analysis for Concept A, the mioltivariate regression effect was 
significant (j) < .01) as were the underlying univariate tests for TSIB 
and POSIA (p .01). 
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TABLE XV 



MULTIVARIATE AND UNIVARIATE iJIALYSIS OF COVARIANCE FOR TIME VARIABLES 
RELATED TO CONCEPT B (tSIB, TPIB, AND POSIB) USING PCSIB AS COVARIATE 



Variable (s) Test Source df F p < 



TSIB, 


TPIB, 


POSIB 
TSIB 
TPIB 
POSIB 


M 

IT 

U 

U 

u 


Equality of 
Regression 


9,131.6 

J,PD 
3,56 
3,56 


0.633 

0.80I+ 
0.026 


.768 
• pop 
.1+97 
.991+ 


TSIB, 


TPIB, 


POSIB 
TSIB 
TPIB 
POSIB 


M 

u 
u 
u 


Regression 


3,57 
1,59 
1,59 
1,59 


1+.531+ 
10.226 
1.858 
7.153 


.006** 
.002** 

.178 
.010** 


TSIB, 


TPIB, 


POSIB 
TSIB 
TPIB 
POSIB 


M 

u 
u 
u 


A X B 


3,57 
1,59 
1,59 
1,59 


I.36I+ 
O.9I+8 
2.175 
0.01+5 


.263 
.331+ 
.11+6 
.832 


TSIB, 


TPIB, 


POSIB 
TSIB 
TPIB 
POSIB 


M 
U 

u 
u 


A 


3,57 
1,59 
1,59 
1,1+9 


2.650 
6.81I+ 
0.091 
0.191 


.057 
.011* 
.761+ 
.661+ 


TSIB, 


TPIB, 


POSIB 
TSIB 
TPIB 
POSIB 


M 

u 
u 
u 


B 


3,57 
1,59 
1,59 
1,59 


0.1+09 
0.017 
O.26I+ 
0.559 


.71+7 
.896 
.609 
.1+58 



*P< .05, **P< .01 
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A* 



A* 



B' 



258.608 


432392 


312.441 


391.184 



345.500 



351.812 



285-524 44.788 



Figure 7. Adjusted means for TSIB (A effect) 



No other multivariate tests were significant. The p-value for the 
multivariate test of the A effect was less than .06. The underlying 
univariate test for the A effect on TSIB was significant (p < .025). 
Figure 7 gives the adjusted means for TSIB and displays a plot of the 
cell means. We observe that if the A effect is significant, the sig- 
nificance probably lies with variable TSIB. It would appear that the 
introduction of negative instances in the treatment for Concept A caused 
subjects to spend more time responding to the treatment items for 
Concept B. Perhaps this is further evidence of the transfer effect of 
negative instances for Concept A to performance on Concept B. 



Summary 

Table XVI summarizes the results of the analyses for Concept A and 
Concept B. For Concept B, there was a significant A effect and B effect 
on achievement (POB) favoring treatments of both positive and negative 
instances. , 
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TABLE m 



SUMMARY OF ANALYSES FOR CONCEPT A AND CONCEPT B FOR WHICH 
STATISTICALLY SIGNIFICANT DIFFERENCES WERE FOUND (p < .05) 



Variable (s) 






Level Favored 


Transfer 


Effects 


P < 


+ ± 


Effect 


Concept A 
TPIA 


A X B 


.038* 




Yes 


POSIA 


A 


.031* 


Yes 




Concept B 
POB 


A 
B 


.02k 
.019 


Yes 
Yes 


Yes 


TSIB 


A 


.011* 


Yes 


Yes 



*ltaivariate tests in a three variable multivariate analysis where the 
multivariate p-values were .066, .072, and .O56, respectively. 



Risking a possible multivariate Type I error (p < .075) there appears 
to be an interaction effect on postfeedback interval during the treatment 
for Concept A (TPIA) and an A effect on stimulus interval during the 
posttest for Concept A (POSIA) and the treatment for Concept B (TSIB). 
The treatments of positive and negative instances appeared to have 
increased the stinultxs interval times. 
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CONCLUSIONS 



Two questions were examined: 

1. What are the different effects of an instructional sequence 
of positive and negative instances and a sequence of all 
positive instances In the acquisition of ccramitativity 
and/or sussociativity? 

2. Assuming there are effects for negative instances, do the 
effects of negative instances for one concept transfer to 
another concept? 

Question 1 was answered as follows: 

For the acquisition of the concept of associativity, a sequence 
of positive and negative instances was favored over a sequence 
of all positive instances. 

Question 2 was answered as follows: 

The acquisition of the concept of associativity was inrproved 
by the effect of negative instances for connmitativity. 
Transfer occurred. 



Discussion 

As was pointed out in the results, if one relaxes the conditions 
controlling T^jrpe I error, it appeared that negative instances of com- 
mutativity increased the total stimulus interval for Instances of both 
associativity and commutativity» This result would tend to weaken the 
advantage cited for negative instances in the conclusions. Further 
study and control of the time variables appears to be appropriate. 

Another possible alternative for the results cited can be proposed. 
It is possible that the subjects simply preserved the same proportion 
of positive and negative instances during the posttest as was presented 
to them diiring treatment, regardless of the concept involved. The low 
reliability estiiiates reported for the posttests may suppor this hypoth- 
esis. Handler and Cowan (1962) have reported such results. An explora- 
tory analysis was performed on the data of this experiment examining 
the mean number of yes responses for each cell on the posttests. The 
results, reported in Appendix A. 10 show both an A and B effect on both 
the criteria for Concept A and for Concept B (p < .01). The more nega- 
tive instances presented in the treatment, the fewer yes responses were 
given on the posttests. These data also support the conclusion that 
the treatments did have an effect. Bourne has also suggested that the 
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variable of the proportion of positive instances is important and 
should be investigated further (Bourne and Gtiy, 1968; Bourne, 1972). 

While the subjects were old enough to be in the formal reasoning 
stage (Inhelder and Piaget, 1958) and on other concept learning tasks, 
ninth graders appear to be as successful as college students (Bourne 
and 0*Banion, 1971), it is possible that the results would be differ- 
ent for subjects of an older age. 

In summary, it is clear that negative instances do have an effect 
on concept learning. However, the imderlying e;q)lanation for the 
effects is not clear from these data. 
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RECOMMENDATIONS 



Most teachers of mathematics are familiar with the problem of 
students overgeneralizing concepts in mathematics. The following 
examples are familiar to all mathematics teachers : 



X y X + y 

S: + £ = c 
b d b + d 

(a + b)'^ = a'^ + b'^ 

/fg = If /g 
f o g = g o f 



One possible strategy for discouraging such overgeneralizations could 
be the introduction of negative instances during the teaching of each 
concept. There has been some evidence that such a strategy is effective 
(Shtunwfi^, I97I; Tennyson, Woolley, and fferrill, 197l)# There has also 
been a great deal of evidence from experimental psychology to support 
the exclusion of negative instances in concept learning (Clark, 1971 )• 

The results of this study are consistent with Tennyson, Woolley, 
and Merrill (1971) and Shumcway (1971)* A treatment of both positive 
and negative instances was superior to a treatment of positive instances 
alone and the effect of negative instances appeaared to transfer fr<Mn one 
concept to another* Three possible e^qplanatlons for the results have 
been proposed: 

El. Negative instances are a necessary and integral part of 
the learning of each concept; 

E2. Negative instances teach subjects to be skeptical, 
independent of a given concept; 

153 • Negative instances sinqoly teach subjects the proportion 
of the criterion instances which should be classified 
as negative using guessing. 
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None of these possible explanations (E1-E3) can be rejected or accepted 
based on the results of this study alone. The following reccomiendations 
are s\iggested for farther study: 

51. A replication of the cairent study with different concepts; 

52. A replication of the current study with subjects of an 
older age; 

53. A replication of the current study with subjects of an 
older age and vith a manipulation of the proporticm of 
negative instances in the criterion measure. 

These studies are not recoomended siarply to verify or not verify that 
negative instances promote concept acquisition. In order to use nega- 
tive instances effectively it is necessary to know why negative instances 
make a difference, as well as that negative instances^do make a differ- 
ence* 

As a practical reconnendation to the teacher of concepts in schools 
the following seems appropriate: 

There is some evidence that negative instances are iapoii;ant 
in the learning of concepts. It wovild seem appropriate for 
the classroom practitioner to begin to cautiously introduce 
negative instances of concepts in instruction* 
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A. 2 GLOSSARY OF TERMS 

1. Associative ; A binary operation * on a set S is said to be asso- 
ciative if and only if for every a, b, and c in S, 

a * (b * c) = (a * b) * c, 

2. Attributes ; Discemable characteristics of an object, event, or 
idea that distinguish it from other objects, events, or ideas. 

3- Bioconditional ; A statement is a bioconditional if and only if it 
is of the form " if and only if 



h. Binary operation ; A binary operation -^^ on a set S is a correspond- 
ence which associates with every ordered pair (a,b) of elements 
of S a unique element a * b of S. 

5. Coimmitative : A binary operation * on a set S is said to be comraa- 
tative if and only if for every a and b in S , 

a * b = b * a. 

6. Concept ; A concept over the class X is a partitioning of a class 
X into two disjoint classes Xi and X2. 

7. Concept acquisition ; Concept acquisition tasks are those concept 
learning tasks where a simple set of instructions would not pro- 
duce the same behavior as the conventional training procedures. 
(Kendler, H. H., 196lf, p. 22?) 

8. Concept identification ; Concept identification tasks are those 
concept learning tasks where instructions coxild produce the same 
behaviors as the conventional training procedures. (Kendler, H. H., 
I96I1, p. 227) 

9. Conditional : A statement is s£iid to be a conditional if and only 
if it is of the form "If , then 

10. Conjunction : A statement is said to be a conjunction if and only 
if it is of the form " and 



11. Coursewriter III ; Coursewriter III is an interactive computer 
language designed for computer-assisted instruction (CAl). 

12. Delay of informative feedback : The delay of informative feedback 
is the length of time between the subject *s response to a question 
and the presentation of the feedback associated with the subject's 
response. 

13. Disjtmction ; A statement is said to be a disjunction if and only 
if it is of the form " and/or . " 
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lU. Negative instance : Given a concept ever a class X with partition 
Xi, X;5 and given that the elements of Xi are examples of the con- 
cept, then the negative instances of the concept over X are the 
elements of Xo. 

15. Positive instances ; Given a concept over a class X vith partition 
Xi , X;2 and given that the elements of Xi are examples of the con- 
cept, then the positive instances of the concept are the elements 
of Xi. 

16. Postfeedback inteanral ; The postfeedback interval is the length of 
time between the presentation of the feedback and the occurrence 
of the next stimulus. 

17. Rational numbers ; The set of rational nmbers Q is the set of all 
quotients of the fozm a/b where a and b are integers and h ^ 0. 

18 • Rules ; Conceptual rules are statements ^ich specify how the 

relevant attributes are ccooLbined for use in classifying an instance. 
Simple rules are typically characterized as conjunctive, disjimctive, 
conditional, or bioconditional depending on the foxm of the defining 
statement . 

19. Stimulus Interval ; The stimulus interval is the length of time the 
stijoiulus is available to the subject for inspection. 

20. Terminal : The word terminal will be used to refer to the IBM 27^1 
computer terminal. 

21. Universal class ; The universal class is the class over which a 
concept is defined. 
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A.3 INTRODUCTION AND PRETEST 



INTRODUCTION: 

Verbal— "This is a computer teiminal* It is a special kind of 
typewriter which has been designed to allow you to conammicate with a 
computer at Ohio State University. 

The computer sends electronic signals over the telephone line, the 
terminal translates the signals to words and types them out. 

Whenever you want to send a message to the computer, you simply 
type your message and the terminal sends it to the con^niter. 

You have been asked to come here to help us find out how effec- 
tively a computer can be used to teach things to students. The computer 
will ask you some mathematics questions and wait for you to answer* Try 
your best to figure out the answer. If your are not sure of an answer 
don't hesitate to type in the answer which you think may be correct. 
The computer will give you hints if you are wrong. 

Your work on the computer has noting to do with any of your courses 
and you are not being graded. Do you iinderstand? 

OKi Press the RETURN key and you can being." 

From Computer 

Welcome to computer-asslsted-lnstructlon* This message Is being transmitted to 
you from the Ohio State University Computer Center. 

Whenever you are asked to answer a question, simply type your answer and then 
hit the RETURN key. 

OKI Let's see If you understand these directions. What Is your first name? 
frank 

Very good, Frank. 

You have successfully communicated with a computer. Remember that after you finish 
typing an answer you must depress the RETURN key. 

The purpose of the time you will spend communicating with the computer Is to 
teach you $ome mathematics. It Is Important for you to be careful and do as well 
as you can. This will help your school to determine the usefulness of computers 
for teaching mathematics. 

Before wc can begin, we need to discuss the meaning of the symbols and notation 
which wll I be used. 

You should be famllar with the following symbols; 

^9 



S VflBOL MEANING 

♦ ADD 
SUBTRACT 

• MULTIPLY 

Notice that the symbol, means mul t lo! 
Here are some examples: 

1. 5 ♦ 7 - 12. 

2. 23-8 - 15. 

3. 9*6 - 5k. 

Hit the RETURNUkey and we will on. 



In the unit you will be studying we will be usine a new symbol In addition 
to the symbols : and *• 

This new symbol Is o. It will be used to define several different ways, 
of combining numbers. Here is an example. 
The letters ^ and may stand for any two numbers. 

a o b » 2*a ♦ b ♦ 3. 



1 o 6 - ? 

The answer to this question Is 
11 

Here is how the answer was figured out: 

Since a o b » 2*a ♦ b ♦ 3, 

1 o 6 » 2*1 ♦6*3 and 

2*1 ♦ 6 ♦ 3 - 11. 



So, 1 o G " 11. 
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th/iinl? """^ ^^.^ answers to the following questions. After you have 
tJSe ihe answer'' ^ ^^^^ ^^^^^ ^^^'^ ^^''^^ -'"^^ 



k o 2 • 7 
6 



No, a o b /* a ♦ b. Remember that aob • 2*a^b43 
In this case a - l» and b - 2. Now try again. 



No, aob / a*b. Recall that aob • 2*a ♦ b ♦ 3. 
In this problem a • i» and b • 2. Try again. 



A 

Let's look at this problem more carefully. You don't have the right Idea. 
In this case, a - i» and b - 2. Notice that aob - 2*a ♦ b ♦ 3, so 
k o 2 • 2H ♦ 2 ♦ 3. Now you should be able to do It correctly. 



13 

Very good. You have the right Idea. 



Remember that aob • ♦ b ♦ 3. 

3 o (1 o 5) • ? 

30 



Nol YOU mult.pUed 3 and 10. You did the part Inside the parentheses correctly. 
NOW you must find the value of 3 o 10. What is 3 o 10 ? 



51 



69 

The parentheses may be causing some confusion. You must find the value 
of the part Inside the parentheses firsts then do the other part. Try again. 

19 

Excellent)! I 

Let's define a o b differently. Suppose aob • l*a* 3*b. 
Then 2 o 1 • 6. What is k o 2 7 



11 

RiKHtN 

If aob « l*a* 3*b, (1 o 2) o 1 » ? 

12 

Very good. 

Reniember that aob can be defined In many different ways. 
Keep this In mind In the next section. 

We are coming; to a very Important part of your session with the computer 
for today. You will be asked to answer several problems In order to see how 
wel you understand what has been discussed so far. 

The computer will tell you how aob Is defined and 2 examples will be 
given. You will then be asked to give answers to 2 specific problems. 
Regardless of your answer the computer will continue on to the next problem. 

Please answer each question carefully so that we will be able to 
determine how well you understand this material. 

When you are ready to start hit the RETURN key. 
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PRETESTS (PCA AND PCB) 

Sample Student Interaction 



a o b « 



t» o 7 • 7^ 



8 o 3 • 3. 



1. 5 o 6 - 7 



2. 2 o (1 o 5) • 7 



Sample ^ogramming^ 



pretes 

1- 0 pr 

2- 0 cm /pre/a o b • b^ 



o 7 • 7^ 



8 o 3 



2- 1 cc / 



1. 5 o 6 • ? 



/6 



2- 2 cc / 



2. 2 o (1 o 5) • 7 



/5 



^ 3- 0 qu a o b • b^ 



'♦0 7 » 7, 



8 o 3 - 3. 



& 3- 1 



!• 5 o 6 - ? 



& 3- 2 ca 6 

& 3- 3 Id cO/c3 

& 3- I* ad 1/cl 

& 3- 5 ty 



A 3- 6 un 
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& 


3- 


7 


Id 


c0/c3 


& 


5- 


8 


ad 


l/c2 


& 


3- 


9 


br 


pr 


& 


ii- 


0 


au 








1 




c 




ii- 


c 


Id 








3 


<td 


1/cl 


& 


t»- 


(» 


ty 




& 




5 


un 




& 


t»- 


6 


Id 


c0/c3 


& 


t»- 


7 


ad 


l/c2 


& 




8 


br 


pr 



nCA-Fretett Itcns PCA FCB 

ItcsB ItenB 

aob«b, h oj m 8o3-3. 

1. 5 o 6 » 7 6 

2. 2 o (1 o 5) ' 7 5 
A o b - 2»(a . b), 3 o 1 > 7 o 2 • 10. 

3. 5 o 2 . 7 6 

^. 9 o (7 o 3) = 7 2 
A o b • l»«a -I- 2«b, 5 o 3 « 26, If o 6 » 28. 

5. (2 o 1) o 3 - 7 k6 

6. 3 o 6 - 7 2k 
AOb.t^-i-2, 'k o 3 m22, 6o3«20. 

7. 3 o 2 - 7 8 

8. 1 o (2 o 3) » 7 10 
aob-9> 5ol-9f 3o8-9. 

9. 7 o 8 - 7 9 

10. If o (1 o 6) » 7 9 
a o b » -I- b), 2 o 5 » 21, 3 o 1 • 12. 

U. 5 o 4 » 7 27 

12. 3 o (2 o 8) « 7 99 
aob»2*, 3o5«8, 2o7«^. 

13. 3 o (2 o 7) » 7 'a 

14. 1 o 7 - 7 2 
a o b « (a»b)^, 2 o 3 » 36,. 5 o 1 - 25. 

15. 1 o (3 o 1) « 7 81 

16. 4 o 2 - 7 6lf 

a o b « a divldtd by b, 

15 o 3 = 5, 2»f o 6 - If. 

17. lU o 2 - 7 7 

18. (20 o 2) o 5 - 7 2 
aob-a, 7o6-7, ifo9-^. J 

19. (5 o 8) o If « 7 5 

20. 9 o 2 • 7 9 
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INTRODUCTION: 



A.U TREATMENTS 



Good morning, Frank 

i am f.lad that you could come back. 

Today we will be looking at several different ways of defining the 
operation o. Once again you will be given a definition of a o b 
followed by 2 examples. Your task is to answer one question for each 
definition of a o b. The question will require a simple *yes* or 
'no' j»nswer. in fact you won't even have to type the whole word, if 
your answer is ves ^ type ^ and if your answer is nft^ type a* After 
you type x or a you will be told if your answer is CORRECT or INCORRECT. 
The computer will then wait until you depress the RETURN key before 
continuing on to the next problem. It Is important that you remember 
to hit the RETURN key when you are ready to go on to the next problem. 
The computer will wait for you to signal it to go on so that you can 
study the problem you have Just answered. Jn this way you will be given 
a chance to decide why your answer was correct or Incorrect. 
Let's do two sample problems. 

SAMPLE l.aob-a^b, lio5-9/ 6o2-8. 

aob • boa? 

y 

Correct. 

SAMPLE 2. a o b « a*b, 2 o 3 • 6, 5 o 7 « 55. 
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a o (b o c> • (a o b) o c ? 



y 



Correct* 



ERIC 



OK. You answered both problems with no trouble* When you are 
ready to begin hit the RETURN key. 



TREATMENT A*"B*' 

Sample Student Interaction 
1. aofa«2*D*a 5oU»9, Ool-J, 

aob • boa? 



Correct. 



2. aob- 3*a*b ♦ 2, 2 o 1 • 8, 5 o 2 « 20. 



aob • boa? 



Correct • 

3. aob-b*a-2, k o 3 • 5, S o 1 • k* 

(a o b) o c « a o (b o c) ? 



Correct. 



58 



TREATMENT A+H*" (continued) 
Sample Programming 



er|c 



treatl 

1- 0 cm / repeat/ 1. aob ■ 2 ^ b ^ a, 
1- 1 cc / 



3 o li - 9, 



0 o 1 • 3. 



aob * boa?/ 



/y/n 

& 2* Oqul. aob ■ 2^b^a« 
& 2- 1 



I o k • 9, 



0 o 1 - 3. 



a 2- 2 
a 2- 3 



aob • boa? 



& 2- i» ca y 

& 2- S Id c0/c3 

& 2- 6 ad 1/cl 

& 2- 7 ty 

Correct. 



& 2* 8 ca n 

& 2* 9 Id cO/ck 

& 2- 10 ad l/c2 

& 2- 11 ty 

Incorrect. 



a 


2- 


12 


un 


Please typi 


& 


3- 


0 


rd 




& 


3- 


1 


ep 




a 


3- 


2 


Id 


c0/c5 


a 


3- 


3 


ad 


c5/c6 


a 


3- 


(» 


ad 


cU/c7 


a 


3- 


S 


Id 


0/c3 


a 


3- 


6 


Id 


0/cU 






0 


cm 


/repeat/ 2. 






1 


cc 


/ 



aob > 3*a*b ♦ 2, 



2 o 1 



3 o 2 



20. 



aob > boa?/ 



/y/n 

& 5- 0 qu 2. aob" 3*a*b ♦ 2, 

»• 5- 1 



2 o 1 - t. 



3 o 



20. 
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TREATMENT A***B^ (continued) 

Sample Programming (continued) 



a o b 



boa? 



& 
& 



5- 



U ca y 

5 Id c0/c3 

6 ad 1/cl 

7 ty 



Correct. 



& I^- 8 n 

& 5- 0 Id cO/cU 

& 5- 10 ad l/c2 

A 5- 11 ty 

Incorrect. 





5- 


12 


un 


Please type either *y* 


h 


6- 


0 


rd 




& 


G- 


1 


ep 




& 


G- 


2 


Id 


cO/c5 


& 


6- 


3 


ad 


c3/c6 


& 


6- 


k 


ad 


,cU/c7 


& 


6- 


S 


Id 


0/c3 


& 


6- 


6 


Id 


0/ck 




7- 


0 


cm 


/repeat/3.- a o b • 




7- 


1 


cc 


/ 



b ♦ a - 2, 



k o I 



5, 



Sol 



/ 

/y/n 



(a o b) o c ■ a o (b o c) ?/ 



& 


8- 


0 


qu 


3. 


& 


8- 


1 






& 


8- 


2 






& 




3 






& 


0 " 


k 


CO 


y 


& 


8- 


5 


Id 


c0/c3 


& 


8- 


6 


ad 


1/cl 




8- 


7 


ty 





a o b 



b ♦ a - 2, 



^ o 3 



5. 



5.0 1 - li. 



(a o b) o c • a o (b o c) 7 
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TREATMEKT A+B"^ (continued) 

Sample Programming (continued) 



ERJC 



Correct. 



& I* 8 ca n 

& 8- 9 Id cQ/ck 

& 8** 10 ad l/c2 

a 8- 11 ty 

Incorrect. 



a 8- 12 UA Please type either *y* or *n.* 
A 9- 0 rd 



a 


9- 


1 


ep 


a 


9- 


2 


Id c0/c5 


a 


9- 


3 


ad c5/c6 


a 


9- 


k 


ad c4/c7 


a 


9- 


S 


Id 0/c5 


a 


9- 


6 


Id 0/ck 



TREATMENT A*B*" 

Samyle Student Interaction 

1. aob»b*a*2, 5ol«6. k o S m 

(a o b) o c • a o (b o c) ? 



Correct. 



^ o b « boa? 

y 



Correct. 
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TREATMENT A'^B*** (continiied) 
Sample Programming 

treat2 

1* 0 cm /repeat/1* aob « b ^ a ^ 2, 
1- 1 cc / 



3 o 1 • 6, 



d o 5 • 11. 



(a o b) o c • a o (b o c) ?/ 
aob « b4a^2/ 



/y/n 

& 2- 0 qu 1 
& 2- 1 



5 o 1 • 6, 



U o 5 « 11< 



& 



2- 
2- 



(a o b) o c " a o (b o c) ? 



& 

& 
& 



& 
& 
& 
& 



2- 
2- 
2- 
2- 



U ca y 

5 Id c0/c5 

6 ad 1/cl 

7 ty 



Correct. 



2- 
2- 

2- 10 ad l/c2 
2- 11 xy 



8 ca n 

9 Id cO/c«* 



Incorrect. 



& 


2- 


12 


un 


Plejse type 


either 


& 


3- 


0 


rd 






& 


3- 


1 


ep 






& 


3- 


2 


Id 


cO/c5 




& 


3- 


3 


ad 


c3/c6 




& 


3- 


k 


ad 


cU/c7 




& 


3- 


5 


Id 


0/c3 




& 


3- 


6 


Id 


0/ck 








0 


cm 


/repeat/2« 


aob 






1 


cc 


/ 




/ 


a 


o 


b 


• boa?/ 





2«a ♦ 2*b, 



1 o l» 



10, 



5 o 2 



10. 
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TREATT'EMT A-B^ (continued) 

Sample Programming (continued) 



/y/n 

& 5- 0 qu 2. 
& 5- 1 



a o b ■ 2*a ♦ 2^b, 



I o k • 10^ 



3 o 2 • 10, 



& 5- 2 
A 5- 3 



aob • boa? 



& 5- <i ca y 

& 5- 5 Id c0/c3 

& 5- 6 ad 1/cX 

& 5- 7 ty 

Correct* 



A 5- 8 ca n 

& 5- 9 Id cO/c^ 

& 5- 10 ad l/c2 

& 5- 11 ty 

Incorrect* 



& 


5- 


12 un 


Please type 


& 


6- 


0 rd 




& 


6- 


1 ep 




& 


6- 


2 Id 


c0/c5 


& 


6- 


3 ad 


c3/c6 


& 


6- 


k ad 


c<i/c7 




& 


6- 


5 Id 0/c3 


& 


6- 


6 Id 


0/ck 



+ ± 

TREATMEMT A B 

Sample Student Interaction 

I. aob- ti*a*b, 2^ o 5 • UO, 3 o 1. . 12. 

(a o b) o c - a o (b o c) 7 



Correct. 
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TREATMEMT A'*"B^ (continued) 

Sample Student Interaction (continued) 



2. aob ■ a^b^l. 



6 o 9 • 16^ 



7 o 3 - 11, 



ERJC 



aob ■ boa? 



Correct* 



Sample Programmin g 



treat3 



}: S J'-^P'"/!. aob - *.a.b, 2o5 - *0, 3 o 1 - 12. 



/ (3 o b) o c - a o (b o c) 7/ 



/y/n 

& 2* 0 qu 1. a o b •« %*a*b, 

& 2-1 



2 o 5 - 



3 o 1 - 12* 



& 2- 2 
& 2- 3 



(a o b) o c • a o (b o c) 7 



& 2- <i ca y 

& 2- 5 Id cO/c3 

& 2- 6 ad 1/cl 

& 2- 7 ty 

Correct. 



& 2- 8 ca n 

& 2- 9 Id cO/c% 

A 2- 10 ad l/c2 

& 2- 11 ty 

Incorrect. 



& 2- 12 un Please type either *y* or 'n. ' 
& 3- 0 rd 



6k 



TREATMEKT A'^B- (continued) 



& 
& 
& 
& 
& 
& 



Sample Prograinmlng (continued) 



1 CP 

2 Id cO/c5 

5 ad c3/c6 
ii ad ck/c7 

3 Id 0/c5 

6 \d 0/ck 

0 cm /repedt/2. aob ■ a^b^ 

1 cc / 



aob ■ boa?/ 



/y/n 

& 3- 0 qu 2. a o b ■ a ♦ b ♦ 1^ 

& 3- 1 



& 3-2 aob"boa7 

& 3- 5 



& 3* <i ca y 

& 3- 3 Id c0/c3 

& 3- G ad 1/cl 

&2 3- 7 ty 

Correct. 



& 3" 8 ca n 

& 3- 9 Id cO/ci» 

& 3- 10 ad l/c2 

& 3- 11 ty 

Incorrect. 



& 3- 12 im Please type either or *n. 
& 6- 0 rd 



& 6- 1 CP 

& 6- 2 Id cO/c3 

& 6- 3 ad c3/c6 

& 6- 3 Id C/c3 

& 6- 6 Id 
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TRI^ATMEMT A-B' 

Sample Student Interaction 

1. a o b - l^*(a ♦ b), 3 o 5 . 32, k o 2 m 2k. 

(a o b) o c • a o (b o c) ? 



Correct. 



2. a o b - 2*a ♦ 2»b, <i o « - 2ii, 1 o 9 - 20. 

aob ■ boa? 

y 

Correct. 

Sample Programming 

i: s«;;;r'^- -^'^ ■ 305-32, .02-2*, 

J 2- O.UI. aob - ..(a.b), 30 5-32, * o 2 - 2*. 



(a o b) o c ■ a o (b o c) ? 





2- 


2 




(a 




2- 


3 






& 


2- 




ca 




& 


2- 


s 


Id 


C0/C3 


& 


2- 


6 


ad 


1/cl 


& 


2- 


7 


ty 



* 2- « Correct. 
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r 



T 



TREATMENT A'B* (continued) 

Sample Programming (continued) 
& 2- 9 ca y 



& 


2- 


10 


Id 


cO/c<> 


6 


2- 


11 


ad 


l/c2 


& 


2- 


12 


ty 




& 


2- 


13 




Incorrect. 


& 


2- 


Ik 


un 


Please type either 


& 


3- 


C 


rd 




& 


3- 


1 


ep 




& 


3- 


2 


Id 


cO/c5 


& 


3- 


3 


ad 


c3/c6 


& 


3- 


k 


ad 


ct»/c7 


& 


3- 


5 


Id 


0/c3 


& 


3- 


6 


Id 


0/c^ 






0 


cm 


/conim/2« a o b • 






1 


cc 


/y/n 


& 


5- 


0 


qu 


2. a o b • 2*a 


a 


5- 


1 






& 


5- 


2 




a o b • bo 


& 


5- 


3 






& 






CO 




& 


5- 


s 


Id 


cO/c3 


& 


5- 


6 


ad 


1/cl 


& 


5- 


7 


ty 




& 


5- 


8 




Correct. 


& 


'5- 


9 


ca 


n 


& 


5* 


10 


Id 


cO/ck 


& 


5- 


11 


ad 


l/c2 


& 


5- 


12 


ty 




& 


5- 


13 




Incorrect. 


& 


5- 


Ih 


un 


Please type either 


& 


6- 


0 


rd 




& 


6- 


1 


ep 




& 


6- 


2 


Id 


cO/c5 


\ 


6- 


3 


ad 


c3/c6 




6- 


k 


ad 


ck/c7 


\ 


6- 


S 


Id 


0/c5 


% 


G- 


6 


Id 


0/zk 



2«a ♦ 2»b, * o « - 2ft, 1 o 9 - 20. 

♦ 2«b, d o 8 - 2t>, 1 o 9 • 20. 
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INSTANCES BY TREATMENTS 

Tr eatment A'^B'^ Concept 

A B 

SAMPLE 1. aob«a + b, 

Uo5=9, 6o2 = 8. 

aob:rboa? 
SAMPI^ 2. a o b = a-^^-b, 2 o 3 = 6, 5 o 7 = 35. 

a o (b o c) = (a o c) o c ? 

1. aob = 2 + b + a, 3oU=9, Ool = 3. 

aob=boa? + 

2. a o. b = 3^^a*b + 2, 2 o I = 8, 3- o 2 = 20. 

aob=boa? + 

3. aob = b+ a-2, k o 3 = ^9 5ol = U. 

(a o b) o c = a.o (b o c) ? + 

k. a o b = the smaller of a and b, 

5oU = U, '303=^ 3. 

(a o b) o c = a o (b o c)? + 

5. a o b = 1 + a + b, U o 3 = 8, 2 o 6 = 9. 

(a o b) o c = a o (b o c) ? + 

6. a 0 b = 3 + 2*a*b, 2 o 2 = 11, 3 o U = 27. 

aob=boa? + 

7. a o b = U*b*a, 1 o 5 = 20, 3 o 2 = 2U. 

(a o b) o c = a o (b o c) ? + 

8. a o b = 2*(a + b) + 1, 

U o 6 = 21, 5 6 3 = 17. 
aob = boa? + 

9. a o b = the larger of a and b, 

608 = 8, 7oU = 7. 

(a o b) o c a o (b o c) ? + 
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Treatment A'*"S*" (continued) Concept 

A B 

10. a o b = (a + b) - 3, 3 o k = 1 o 2 = 0. 

aob=boa? + 

11. a o b = a*b + 4, 5 o 2 = l4, 3 o 4 = 16. 

aob=boa? + 

12. a o b = 0, 7 o 6 = 0, 2 o 9 = 0. 

aob=boa? + 

13. a o b = a + b + 5, 2 o 6 = 13, 5 o 1 = 11. 

(a o b) o c = a o (b o c) ? + 
lU. a o b = 1, 4 o 3 = 1, 2 o 7 = 1. 

(a o b) o c = a o (b o c) ? + 

15. a o b = 3*b*a, 2 o 3 = I8, 4 o 1 = 12. 

(a o b) o c = a o (b o c) ? + 

16. a o b = 2, 4 o 3 = 2, 5 o 7 = 2. 

aob=boa? + 

17. aob = a + b-2, 5o3=6, 2o7 = 7. 

(a o b) o c = a o (b o c) ? + 

18. a o b = a*b - 1, 4 o 5 = I9, 8 o 3 = 23. 

aob=boa? + 

19. a o b = a + b + 3, 1 o 9 = 13, 7 o 0 = 10. 

(a o b) o c = a o (b o c) ? + 

20. a o b = U*a*b, 2ol=8, 303=36 

aob=boa? + 

21. a o b = 5*(a + b), 4 o 5 = 1*5, 3 o 1 = 20. 

aob=boa? + 
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Treatment A'*'B^ (continued) Concept 

A B 

22. a o b = b, 5 o 2 = 7 o 9 --x 7. 

(a o b) o c a o (b o c) ? + 

23. 1 o 1) = 2*a I- 2*b, 3 o 5 = l6, . 0 o 5 = 10. 

ao'» = boa? 4. 
2U. a o b = 5, 209=5, .906=5. 

(a o b) o c -- a o (b o c) ? + 

25. a o b = b*a, 3 o 6 = 18, 4 o 2 = 8. 

(a o b) o c = a o (b o c) ? + 

26. a o b = b, 4 o 7 = 7, 3 o 2 = 2. 

(a o b) o c = a o (b o c) ? + 

27. o b = 3, 1 o 8 = 3, 7 o. 5 = 3. 

aob=boa? + 

28. a o b = 6*a*b, 3 o 1 = 18, 2 o 5 = 60. 

(a o b) o c = a o (b o c) ? + 

29. a o b = a, if a 5^ b, otherwise a o b = b, 

k o 3 = k, 606=6. 

(a o b) o c = a o (b o c) ? + 

30. aob = 2*(a+b), 3 o 5 = I6, 1* o 1 = 10. 

aob=boa? + 

31. a o b = k*a.*h - 3, 2 o 5 = 37, 4 o 1 = I3. 

aob=boa? + 

32. aob=2, 708 = 2, Uo3 = 2. 

(aob)oc = ao(boc)? + 
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Treatment A'^B^ (continued) 

33. .'I o b 2^ {a h b + 1), 

3 o 18, 0 o 1 16. 

a t« b b o a ? 
3^. a o b = b + a + 1, 1 o 0 = 2, U o 7 = 12» 

(a o b) o c = a o (b o c) ? 

35. a o b = 7 + a + b, 0 o 5 = 12, 8 o 3 = l8* 

aob=boa? 

36. a o b = 5*b*a, 5 o 1 = 25, 2 o 6 = 60. 

(a o b) o c = a o (b o c) ? 

37. a o b =r b, if b / a, otherwise a o b = a, 

5 o 5 = 5, 7 o 2 .= 2. 

(a o b) o c = a o (b o c) ? 

38. a o b = U + 3*a + 3-K^b, 

0 o U = 16, 2 o 3 ^ 19. 

aob = boa? 

39. a o b = a + b + 3, U o 6 = I3, 7 o 9 = 19. 

aob=boa? 
ifO» a o b := 6, 508=6, 7 o U - 6. 

aob=boa? 



Concept 
A B 
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Treatment A-B"*" Concept 

















SAMPLE 1. 


a o b a + b, 
aob = boa? 


U o 5 


= 9, 


o o 2 = 


Q 

O. 




SAMPLE 2. 


a o b a*b, 


2 o 3 


= 6, 


5 o 7 = 


35. 






a o (b o c) - (a 


o b) o c ? 








1. a o b 


= b + a + 2, 
(a o b) o c = a 


3 o 1 
o (b o 


= 6, 
c) ? 


4 o 5 = 


11. 




2. a o b 


= 2*a + 2*b, 
aob=boa? 


1 o U 


= 10, 


3 o 2 = 


10. 


+ 


3. a o b 


= k*a*h, 

(a o b) o c = a 


3 o 2 
o (b o 


= 2U, 
c) ? 


U o 5 = 


80. 




k. a o b 


= 2*a + 3*b, 
aob=boa? 


2 o 3 


- 13, 


h o 1 = 


11. 


- 


5. a o b 


= a divided by b 
aob-boa? 


> 

21 o : 


J = 7, 


10 o k -- 


= 2.5. 


- 


6. a o b 


= a*b - 1, 
aob=boa? 


2 o h 


= 7, 


5 o 3 = 


14. 


+ 


7. a o b 


= a + b + 1, 
(a o b) o c = a 


6 o 9 
o (b o 


= 16, 
c) ? 


7 o 4 = 


12. 




8. a o b 


= (a - b) + 1, 
aob-boa? 


5 o 2 


= »^, 


3 o 3 = 


1. 




9. a o b 


= h + a + h, 
(a o b) o c = a 


1 o 5 
o (b o 


= 10, 
c) ? 


3 o 2 = 


9. 




LO. a o b 


= 3*a*b, 

aob = boa? 


k o2 


= 2U, 


1 o 7 = 


21. 


+ 
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Treatment A^B"^ (continued) Concept 
A B 



11. 


a 


o 


b = 1, 


6 o 9 


= 1, 


7 o 3 = 1. 












(a o b) o c = a 


o (b 


o 


c) ? 






+ 


12. 


a 


o 


b = 5 + (a + b), 
aob = boa? 


2 o 


5 


= 12, 


7 o 3 = 15. 


+ 




13- 


a 


o 


b = a if a ^ b, otherwise a o b 
k o 9 = 


= b, 
5 o 5 - 5. 












(a o b) o c = a 


o (b 


o 


c) ? 






+ 


Ih. 


a 


o 


b = a*b + 1, 
(a o b) o c = a 


3 o 
o (b 


o 


= 13, 
c) ? 


7 o 2 = 15. 






15. 


a 


o 


b = a + b - 1, 

aob=boa? 


k o 


8 


= 11, 


0 o 1 = 0. 






16. 


a 


o 


b = 6*b*a, 
(a o b) o c = a 


2 o 
o (b 


3 
o 


= 36, 
c) ? 


U o 1 = 24. 






17. 


a 


o 


b = 4*b + a, 
aob = boa? 


3 o 


6 


= 27, 


5 o 2 = 13. 








a 


o 


b = 2, 
(a o b) o c = a 


9 o 
o (b 


o 


= 2, 
c) ? 


5 o 3 = 2. 






19. 


a 


o 


b = a, 
aob=boa? 


8 o 


3 


= 8, 


1 o 9 = 1. 






20. 


a 


o 


b = a + b + 3, 
(a o b) o c = a 


4 o 
o (b 


2 
o 


= 9, 
c) ? 


8 o 9 - 20. 




+ 


21. 


a 


o 


b = 5*(a + b), 
aob=boa? 


2 o 


7 


= »*5, 


5 o 3 = 40. 


+ 




22. 


a 


o 


b = a*b + hi 


3 o 


7 


= 25, 


5 o 2 = 14. 







aob=boa? + 



Ireatment A^B**' (continued) 

23. a o b - S^a^b, 1 o 7 = 21, 9 o 2 = 54. 

(a o b) o c = a o (b o c) ? 
2U. a o b = a, 5 o 6 = 5, 9 o 3 = 9. 

(a o b) o c = a o (b o c) ? 

25. a o b = b if b / a, otherwise a o b = a, 

509=9, 2o2 = 2. 

aob=boa? 

26. aob = a-b, 703 = 1*, 9o8 = l. 

acb:^ boa? 

27. aob=aifa>b, othervd.se a o b = b, 

2 ok = ky 5o3=5. 

(a o b) o c = a o (b o c) ? 
28* a o b = a + 3^b, 1 o U = 13, 3 o 2 = 9. 
aob=boa? 
. 29. a o b = 6, 509 = 6, 3 o 0 = 6. 

aob=boa? 

30. a o b = 2^a^b, 2 o 7 = 28, 5 o U = UO. 

(a o b) o c = a o (b o c) ? 

31. aob = bifb/a, othervd.se, a o b = a, 

303 = 3, U o 5 = 5. 

(a o b) o c = a o (b o c) ? 

32. aob = 0, 508 = 0, 3o3=0. 

aob=boa? 

33. a o b = 5, 1* o 9 = 5, 3 o 1 = 5. 

(a o b) o c = a o (b o c) ? 



Concept 
A B 



7h 
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Treatment A^Cf*" (continued) Concopt 
A B 



3h. 


aob = 7 + a+b, 
a I) b = b o a 


2 o 

*> 


6 


= 15, 


8 0 3 = 


18. 


+ 




35. 


aob = aifa<b3 


otherwise a o b 
U o 2 = 2, 


= b, 

•5 _ Q 
3 O O : 


3. 








^a o o c = 


a o (b 


o 


c) ? 








+ 


3d. 


a O D = 

a o b = b o a 


7 o 


9 


= 9, 


Q _ o 

o o 3 = 


3. 






37. 


aob = a + b + 8. 


k o 


7 


= 19, 


6 o 3 = 


17. 








(a o b) o c = 


a o (b 


o 


c) ? 








+ 


38. 


a o b = 0, 


9 o 


5 


= 0, 


1 o 6 - 


0. 








(a o b) o c = 


a o (b 


o 


c) ? 








+ 


39. 


a o b = b. 


k o 


7 


= 7, 


8 o 3 - 


3. 








(a o b) o c = 


a o (b 


o 


c) ? 








+ 



ho. aob = aifa^b, otherwise, a o b = b, 

2o8 = 2, Uol=U. 



aob=boa? 
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Treatment A B~ Concept 

A B 

SAMPLE 1. aob a+b, Uo5=9, 6o2=8. 

aob-boa? 
SAMPLE 2. a o b ^ a-'^'b, 2 o 3 = 6, 5 o 7 = 35. 

a o (b o c) = (a o b) o c ? 

1. nob- U^a^b, 2 o 5 = UO, 3 o 1 = 12. 

(a o b) o c = a o (b o c) ? + 

2. aob=a+b + l, 6o9=l6, 7o3 = ll. 

aob=boa? + 

3. a o b = a*b + 3 o 9 = 31, 8 o 2 = 20. 

aob-boa? + 
U. a o b = a, 7 o U = 7, 10 o 8 = 10. 

(a o b) o c = a o (b o c) ? + 

5. aob=6, 5o9=6, 5o3=6. 

aob = boa? + 

6. aob=0, Uo9=0, 5o3=0. 

aob = boa? 

7. aob=a-b, 6oU = 2, 13o6=7. 

(a o b) o c = a o (b o c) ? 

8. a o b = a*b - 1, " U o 7 = 27, 6 o 2 = 11. 

aob =: boa? + 

9. a o b = 2*a*b - 1, U o 8 = 63, 5 o 2 - I9. 

(a o b) o c = a o (b o c) ? 
10. a o b = a*b + 3, 2 o 9 = 21, U o 1 = 7. 

(aob)oc=ao(boc)? 
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Treatment A B (continued) Concept 

A B 



11. 


a 


0 b = 2*a + 2*b, 


307 


= 20, 


5 0 2 = 14. 










a 0 b = b 0 a 














12. 


a 0 b = U*(a + b), 


k 0 


2 


= 24, 


5 0 6 = 44. 










a 0 b = b 0 a 










+ 




13. 


a 


0 b = 3*a*b + 2, 
a 0 b = b 0 a 


k 0 


1 


= li^. 


7 0 3 = 65. 


+ 




Ik. 


a 


0 b = 6*(a + b), 
a 0 b = b 0 a 


3 0 


2 


= 30, 


5 0 4 = 54. 


1 




15. 


a 


0 b = a if a / bj 


otherwise a 0 b = 
305=3, 


I) 

4*0 4 = 4. 










(a 0 b) 0 c = 


a 0 (b 


0 


c) ? 






+ 


16. 


a 


0 b = 5*(a + t>) - 
(a 0 b) 0 c = 


• 2, 

k 0 
a 0 (b 


9 
0 


= 63, 
c) ? 


6 0 4 = 48. 






17. 


a 


0 b = 2, 


3 0 


7 


= 2, 


9 0 2 = 2. 










(a 0 b) 0 c = 


a 0 (b 


0 


c) ? 






+ 


18, 


a 


0 b = 3, 

a 0 b = b 0 a 


6 0 


8 


= 3, 


709 = 3. 


+ 




19. 


a 


0 b = 3*b + 2*a, 
(a 0 b) 0 c = 


3 0 
a 0 (b 


7 
0 


= 27, 
c) ? 


5 0 6 = 28. 






20. 


a 


0 b = b if b / a, 


otherwise a 0 b = 
4 0 8 = 8, 


a, 

505 = 5. 










(a 0 b) 0 c = 


a 0 (b 


0 


c) ? 






+ 


21. 


a 


0 b = 1, 


2 0 


9 


= 1, 


4 0 5 = 1. 







aob = boa? + 
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Treatment A'*"B- (continued) Concept 

A B 

22. a o b = 5-xa + 5*b, 3 o 5 = 1+0, 2 o 1 = I5. 

aob=boa? + 

23. a o b =: a divided by b, 

7 o 3 = 2, 18 o 6 = 3. 

(a o b) o c = a o (b o c) ? 
2k, a o b = 3*a*b, 2 o 8 = U8, 6 o 5 = 90. 

aob=boa? + 

25. a o b = a + b - 1, U o 7 = 10, 5 o 2 = 6, 

(a o b) o c = a o (b o c) ? + 

26. a o b = 2*a*b, k o 3 = 2k, 5 o 6 = 60. 

(a o b) o c = a o (b o c) ? + 

27. a o b = 3 + 2*a + 2*b, 

1 o 9 = 23, U o 2 = 15. 
aob=boa? . + 

28. a o b = 2*(a + b) + 1, 

3 o 7 = 21, 5 o 2 = 15. 
(a o b) o c = a o (b o c) ? 

29. a o b = a + b + 3, 2 o 8 = I3, 5 o 1 = Q. 

aob=boa? + 

30. a o b = 5, 609=5, 703=5. 

(a o b) o c = a o (b o c) ? + 

31. aob = b-a, 5o9 = U, 3o6=3. 

(a o b) o c = a o (b o c) ? 

32. a o b = 2*(a + b) + 1, 

I| o 2 = 13, 6 o 9 = 31. 
aob=boa? + 
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Treatment A'*'B"*' (continued) 



Concept 
A B 



33. a o b = 3*b - a, 4 c 3 = 5, 3 o k = 7. 

(a o b) o c = a o (b o c) ? 

3k. a o b = 3*(a + b + 2), • 

2 o 5 = 27, U o 1 = 21. 

aob=boa? 

35. a o b = b, 308 = 8, 7 o k = k. 

(a o b) o c = a o (b o c) ? 

36. a o b = 2*a + 5*b, 1* o 3 = 23, 6 o 2 = 22. 

(a o b) o c = a o (b o c) ? 

37. a o b = k*a.*h - 1, 2 o 3 = 23, 5 o 1 = 19. 

aob=boa? 

38. a o b = 0, 5 o 9 = 0, 4 o 2 = 0. 

(aob)oc = ao(boc)? 
39- a o b = (a + b) - 2, 4 o 5 = 7, 2 o 8 = 8. 

aob=boa? 
kO. a o b = 3 + 2*a*b, 4 o 1 = 11, 5 o 8 = 83. 

aob=boa? 
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T reatment A-B- Concept 

A B 

SAMPLK 1. aob:a+b, k o 3 = 9, 6o2 = 8. 

aob = boa? 
SAMPLE 2. a o b - a*b, 2 0 3=6, 5 o 7 = 35. 

a o (b o c) = (a o b) o c ? 

1. a o b = l^*(a + b), 3 o 5 = 32, 1^ o 2 = 2l^. 

(a o b) o c = a o (b o c) ? ^ 

2. a o b = 2*a + 2*b, 1^ o 8 = 2l^, 1 o 9 = 20. 

aob=boa? + 

3. a o b = l^*a*b, 5 o 2 = 1^0, 3 o 1 = 12. 

(a o b) o c = a o (b o c) ? + 
k. a o b = 2*a + 3*b, 5 o 3 = 19, 7 o 2 = 20. 
aob-boa? 

5. a o b = a divided by b, 

16 o 1^ = 1^, ll^ o 5 = 2.30. 

aob = boci? 

6. a o b = a*b - 1, 1^ o 7 = 27, 6 o 8 = 1^7. 

aob=boa? + 

7. a o b = a + b - 1,. 7 o 9 = 15, 3 o 8 = 10. 

(a o b) o c = a o (b o c) ? + 

8. a o b = 2*(a - b) + 1, 1^ o 1 = 7, 8 o 3 = 11. 

aob=boa? 

9. a o b = 2*a*b - 1, 1^ o 7 = 55, 2 o 1 = 3. 

(a o b) o c = a o (b c c) ? 
10. a o b r- 3*a*b, 8 o 2 = 1^8, 2 o 6 = 36. 

aob=boa? + 
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ireatment 


A*B^ (continued) 




11. 


a o 


D = 5 + ' 


- 2, 








3 o 5 = 38, 






(a o b) o c = 


a o (b o c) ? 


12. 


a o 


b = 3 + 2^{a, + 


b). 








o n ft - 

J o o - tip. 






a o b = b o a 






a o 


D = a ir a ^ D 










3 o 3 = 3, 






(a o b) o c = 


a o (b o c) ? 


lU. 


a o 


b = a - b. 


12 o 5 = 7, 






(a o b) o c = 


a o (b o c) ? 


15. 


a o 


b = 3*b - 2*a 


5 o 8 = 14, 






(a o b) o c = 


a o (b o c) ? 


16. 


a o 


b = a + b + 1, 


9 o 8 = 18, 



Concept 
A B 



aob = boa? 

17. a o b = 4*b + a, 2 o 8 = 3^, 7 o 3 = I9. 

aob=boa? 

18. a o b = 2, 709 = 2, 4 o 8 = 2. 



7 0 


9 = 2, 


0 (b 


0 c) ? 


9 0 


2 = 9, 



19. a o b = a, 9 o 2 = 9, 4 o 8 = 4. 



20. a o b = 2*b - a, 5 o 4 = 3, 9 o 7 = 5. 



boa?. 




• a. 


5 0 4 = 3, 


0 c = a 


0 (b 0 c) ? 


+ b). 


4 0 8 = 60, 


boa? 
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Treatment A-B"" (continued) Concept 
A B 

22. a o b = a^b + I4, 7 o 9 = 67, 8 o 1 = 12. 

aob=boa? + 

23. -i o b = a^b f 3, 5 o 7 = 38, 9 o 2 - 21. 

(a o b) o c = a o (b o c) ? 
2U. a o b - b, 803=3, 5 o 2 = 2. 

aob=boa? 

25. a o b = b, if b / a, otherwise a o b = a, 

7o7=7, Uo9=9. 

aob=boa? 

26. aob=a-b, 8o2=6, 908= 1. 

aob=boa? 

27. a o b a divided by b, 

9o3=3, 12o8 = 1.5. 

(a o b) o c = a o (b o c) ? 

28. a o b = 3*a + 2*b, U o 3 = 18, 608=3^. 

-^aob=boa? 

29. a o b = 6, U o 9 = 6, 803=6. 

aob-boa? + 

30. a o b .= 2*a-5<b, 5 o 6 = 60, 2 o 9 = 36. 

(a o b) o c = a o (b o c) ? + 

31. n o b := b, if b / a, otherwise a o b = a, 

608=8, • 2o2=2. 

(a o b) 0 c = a o (b o c) ? + 

32. a o b = 0, 809=0, 307=0. 

aob=boa? + 



ERLC 
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Treatment A B (continued) Concept 

A B 



33. 


a 


o b = 


5, 




U o 7 


= 5. 


6 o Q - 








(a 


o b) o c = 


a 


o (b o 


c) ? 








a 


o b = 


7 + a + b. 




U o 7 


= 18. 


Q o - 


22 






a o b = b o a 


9 












a 


o b = 


3*b - a 




U o 7 




O U - 


D • 






(a 


o b) o c = 




o (b o 








36. 


a 


o b = 


a. 




9 o 2 


= 9, 


4 o 5 = 








(a 


o b) o c = 


a 


o (b o 


c) ? 






37. 


a 


o b = 


2*a + 5*b, 




U o 3 


= 23, 


6 o 2 = 


22. 






(a 


o b) o c = 


a 


o (b o 


c) ? 






38. 


a 


o b = 


0, 




8 o U 


= 0, 


5 o 7 = 


0. 






(a 


o b) o c = 


a 


o (b o 


c) ? 






39. 


a 


o b = 


a if a / b, 


otherwise, a o b 
3 o 7 = 3, 


= b, 
5 o 2 = 








a o b = b o a 


9 












a 


o b = 


b. 




7 o 3 


= 3, 


4 o 5 = 


5. 



(a o b) o c = a o (b o c) ? 
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A. 5 POSTTEST (POA AMD POB) 

INTRODUCTION: 



Welcome back, Frank. How have you been since you were here the Ust time? 
(Type a one word description.) 



fine 
Good. 



As you should know, today will be your last session with the computer terminal. 
The material which will be presented will be very similar to what you have already seen. 
The operation o will be defined followed by 2 examples. You will then be asked to 
respond to 2 questions clout the way o has been defined. Remember to follow these 
simple Instructions In answering each question: 

1. Be very careful and take as much time as you nee-l. 

^' VuJ^Vl a 'yes' or • o' answer to each problem. 

Simply type 'y' if your answer is 'yes,' and .i' if your answer Is 'no.' 

3. After you type your answer be sure to depress the RETURN key. 

You will notice that y >j will not be told whether your answer is CORRECT or INCORRECT. 
So, there will be no need for you to hit the RETURN key in order to go on to the 
next item. Hit the RETURN key and we will ber.in. 

POSTTI'IST 

Sample Student Interaction 

1. a o b - 2(a - b), 3 o 1 . 5 o 2 - 6. 

(a o b) o c • a o (b o c) 7* 



aob • boa? 
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POSTTEST (continued) 

Sample Student Interaction (continued) 

2, a o b « (a • b) ♦ 5, 7 o % - 6, 3 0 1-5. 

(a o b) o c ■ a o (b o c) ? 



Sample Prograimning 
1- 0 pr 

1- 1 ty 1. a o b - 2(a - b)^ 3 o 1 - 5 o 2 • 6, 



2- 0 cm /postma/n/y 
& 5- 0 qu (a o b) o c - a o (b o c) 7 



& 


5- 


1 


ca 


n 


& 


5- 


2 


Id 


cO/c3 


& 


5- 


3 


ad 


l/cl 


it 






ty 




& 


5- 


0 


qu 


(a 



& 


3- 


1 


ca 


n 


& 


5- 


2 


Id 


c0/c5 


& 


5- 


3 


ad 


l/cl 


& 


5- 


k 


ty 




& 


5- 


5 


ca 


y 


& 


3- 


6 


Id 


cO/ci» 


& 


3- 


7 


ad 


l/c2 


& 


5- 


8 


ty 




& 


5- 


9 


un 


Please type either 'y* 




l»- 


0 


cm 


/postmc/n/y 


& 


5- 


0 


qu 


aob « boa? 
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POSTTEST (continued) 



Sample Programmin g (continued) 



& 5- 1 ca n 

& 5- 2 Id c0/c3 

& 5- 3 ad 1/cl 

& 5- U ty 



& 5- 5 ca y 

& 5- 6 Id cO/cU 

& 5- 7 ad l/c2 



& S- 8 ty 

& 5- 9 un Please type either 'y* or 



t 
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Posttest (1K)A and FOB) Concept 

A B 

1. a o b = 2(a - b), 3 o 1 = 5 o 2 = 6. 

(a o b) o c = a o (b o c) ? 
aob=boa? 

2. a o b = (a - b) + 3, 7 o U = 6, 3 o 1 = 5- 

(a o b) o c = a o (b o c) ? 
aob=boa? 

3. aob=fc, Uo7 = 7, 8o3=3. 

aob=b>a? 

(a o b) o c = a o (b o c) ? + 
k. a o b = 3(a + b), 2 o 5 = 21, 3 o 1 = 12.. 
(a o b) o c = a o (b o c) ? 

aob=boa? + 

5. a o b = a divided by b, 

15 o 3 = 5, 2l| o 6 = 

(a o b) o c = a o (b o c) ? 
aob=boa? 

6. a o b = (a*b)^, 2 o 3 = 36, 5 o 1 = 25- 

(a o b) o c = a o (b o c) ? 

aob=boa? + 

7. aob-a, 706:= 7, Uo9=9* 

(a o b) o c = a o (b o c) ? + 
aob=boa? 

8. a o b = a*b + 2, U o 5 = 22, 6 o 3 = 20* 

(a o b) o c =^ a o (b o c) ? 

aob^boa? + 
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Posttest (POA and POB) (Continued) Concept 

A B 

9. a o b = 2% 3 o 5 = 8, 2 o 7 = h. 

aob = boa? 
(a o b) o c = a o (b o c) ? 

10. a o b = the smaller of a and b, 

k o k ='Tf, 9 o 5 = 5. 

aob=boa? + 

(a o b) o c = a o (b o c) ? + 

11. a o b = (a*b) divided by 3, 

2o6 = U, 9ol* = 12. 

(a o b) o c = a o (b o c) ? + 
aob = boa? + 

12. a o b = 9, 5 o 1 = 9, 308=9. 

(a o b) o c = a o (b o c) ? + 
aob=boa? + 

13. a o b = U^a + U^b, 2 o 3 = 20, 5 o 1 = 2U* 

(a o b) o c = a o (b o c) ? 

aob=boa? + 

Ik. a o b = a^ + b'^, 3 o 2 = I7, k o 2 = 2k. 

aob=boa? 

(a o b) o c = a o (b o c) ? 

15. a o b - the larger of a and b, 

903 = 9, Uo6=6. 

a o b'= boa? + 

(a o b) o c = a o (b o c) ? + 
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Posttest (POA and FOB) (Continued) 

16. a o b = (a - b)^, 5o2=9, 6ol4 = l4. 

(a o b) o c = a o (b o c) ? 
aob=boa? 

17. a o b = a% 2 o 3 = 8, k o 2 = l6. 

aobirboa? 

(a o b) o c = a o (b o c) ? 

18. a o b = (a + b) divided by 2, 

5o7=6, 8o6=7. 

(a o b) o c = a o (b o c) ? 
aob=boa? 

19. a o b = U*a + 2*b, 5 o 3 = 26, U o 6 = 28. 

(a o b) o c = a o (b o c) ? 
aob=boa? 

20. a o b = 3*a*b, Uo5=60, 2ol = 6. 

(a o b) o c - a o (b o c) ? 
aob:: boa? 



Concept 
A B 



ERLC 
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A,6 SUBJECTS DROPPED 



S ubject Treatment Reason for Drop 

*1101 A+Ri Data accidentally destroyed by computer center 

personnel (I-19-72). 

110^ Randomly dropped to achieve equal cell sizes. 

1105 Randomly dropped to achieve eq\ial cell sizes. 

1109 Randomly dropped to achieve eq\ial cell sizes. 

1110 Randomly dropped to achieve eq\ial cell sizes. 
*1201 A±I>i- Absent three times for treatment session. 
*1207 Dropped out of school. 

1209 Randomly dropped to achieve equal cell sizes. 

121k Consistently absent from school. 

1218 Consistently absent from school. 

*21^3 A+B± Data accidentiy destroyed by computer center 

personnel (I-I9-72). 
^106 Consistently absent from school. 

2107 Data accidentiy destroyed by computer center 

personnel ( 1-19-72 ). 
2111 Consistently absent from school. 

2120 Computer system failed. 

^202 A±B± Data accidentiy destroyed by computer center 

personnel (I-I9-72). 
2206 Terminal errors. 

2208 Data accidentiy destroyed by computer center 

personnel (1-19-72). 
2213 Randomly dropped to achieve equal cell sizes. 

^216 Absent three times for treatment session. 

2219 Randomly dropped to achieve equal cell sizes. 

* Sub/iect identification number vas reassigned to another subject in 
same treatment. 

Summary 

Treatment Wumber Randomly Dropped xotal Mumber Dropped 

Ai-B-i- k 5 

AilM' ' 1 5 

A I H:» 0 5 

A±B+ 6 

Total 7 21 



A. 7 DESCRIPTION AND TIME SCHEDULE FOR PILOT STUDIES, 
DATA COLLECTION, ^J^ID ANALYSIS 



Dates 



Event 



9-68 to 5-69 



6-71 to 9-71 

9-71 to 11-71 
11-71 to 12-71 

1-72 to U-72 
5-Y2 to 6-72 



The study conducted by the author at Mar shall - 
University High School during the academic year 1968- 
1969 is viewed as a pilot for this study (Shumway, 1970 
and 1971). The sample was 8U eighth grade mathematics 
students randomly assigned to four classes. Two teach- 
ers each taught two classes, one receiving a treatment 
of all positive instances and the other a treatment of 
both positive and negative instances. 

The d\iration of the experiment was 65 school days. 
Among other concepts, the concepts of comrautativity, 
associativity, closure, identity element, inverse ele- 
ment and distributivity were used. A criterion measure 
was developed for these concepts and many binary opera- 
tici-S were invented to provide appropriate positive and 
negative instances. Negative instances appeared to 
discourage the common error of overgeneralization. 
Commutativity ^nd associativity were deemed appropriate 
concepts for further study. 

Pretest, treatment and posttest material were programmed 
in Coursewriter III. 

Preliminary pilot and debugging of computerized materials. 

Pilot Study II. Forty-four college students were ran- 
domly assigned in equal numbers to the four treatment 
groups. Extensive comments were solicited. Reliabil- 
ity estimates for the pre- and posttests were calctila- 
ted. Based on this pilot data, the number of items in 
each pretest was cut from 20 to 10. 

Data collected for actual study. 

Analysis and final report. 
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A. 8 GLOSSARY OF VARIABLE NAMES 

Achievement Variables 

Name 
PGA 

PCB 

TA 
TB 
TOA 
FOB 

Temporal Variables 



Name Description 

PCSIA Stimulus Intervals for PCA 

PCSIB Stimulus Intervals for PCB 

TSIA Stimulus Intervals for TA 

TSIB Stimulus Intervals for TB 

TPIA Postfeedbewk Intervals for TA 

TPIB Postfeedback Intervals for TB 

POSIA Stimxaus Intervals for PGA 

POSII^ Stimulus Intervals for POB 



Description 

Pretest, Calculations without 
parentheses 

Pretest, Calculations with 
parentheses 

Treatment, Concept A 

Treatment, Concept B 

Posttest, Concept A 

Posttest, Concept B 
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A. 10 POST HOC MALYSIS OF 'Y' RESPONSES DURING FOSTTESTS 



As a post hoc exploratory analysis , the variables j the number of 
'y' responses on PGA (POAY) and the number of 'y' responses on FOB 
(POBY), were subject to an analysis of variance. Table XVIII summsTizes 
the results of the post hoc analysis of POitY and POBY. Figures 8 and 9 
give the cell means and standard deviations and a plot of the cell 
means. There was a significant A effect and B effect for both EOAY and 
POBY. 



TABLE XVIII 

POST HOC ANOVA OF THE NUMBER 
OF 'Y' RESPONSES ON POA AND FOB 



Variable 


Effects 






Level Favored* 


Transfer 


F 


P < 


+ ± 


Effect 


POAY 


A X B 


0.231^ 


.630 








A 


23.076 


.001** 


Yes 






B 


7.390 


..00^* 


Yes 


Yes 


POBY 


A X B 


3.6lf7 


.061 








A 


26.067 


.001** 


Yes 


Yes 




B 


31.062 


.001** 


Yes 





"Favored on number of 'y' responses means group favored made fewer 'v' 
responses . 



< .05, **p < .01. 
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Figure 8. Cell means for POAY (A effect and B effect) 
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Figure 9. Cell means for POBY (A effect and B effect) 
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